2026-03-28 08:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 08:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 08:35:05 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-28 08:35:05 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 08:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 08:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 08:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 08:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 08:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: cf435a416151bd59
2026-03-28 08:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 08:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-28T08_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 08:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 08:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 08:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 08:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 08:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 08:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 08:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 08:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 08:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 08:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 08:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 08:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 08:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 08:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 08:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 08:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 08:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 08:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 08:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 08:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 08:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 08:35:17 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:17 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-28 08:35:17 [auto1.be] INFO: Scrape type for TF70513: 1
2026-03-28 08:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:17 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-28 08:35:17 [auto1.be] INFO: Scrape type for ZD95004: 1
2026-03-28 08:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:17 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-28 08:35:17 [auto1.be] INFO: Scrape type for ES25967: 2
2026-03-28 08:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-28 08:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d3289d-eb7b-5545-b43e-8b22e2c78374 with scrape type 2
2026-03-28 08:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d3289d-eb7b-5545-b43e-8b22e2c78374 with scrape type 2
2026-03-28 08:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9d3289d-eb7b-5545-b43e-8b22e2c78374, identifier: ES25967
2026-03-28 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-28 08:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967 to the API
2026-03-28 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:06:00Z',
 'fuel_type': 'petrol',
 'id': 'b9d3289d-eb7b-5545-b43e-8b22e2c78374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES25967',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 140598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-25',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport Plus',
 'transmission': 'manual',
 'trim': 'Sport Plus',
 'year': 2007}
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Saving data for ES25967: {'auction_closing_time': 1774883160.0, 'created_time': 1774557498.524283, 'last_price_update_time': 1774686918.183568}
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES25967') HTTP/1.1" 204 0
2026-03-28 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Scrape type for PC01829: 1
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Scrape type for RW32127: 1
2026-03-28 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Scrape type for CE27208: 1
2026-03-28 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Scrape type for CG81228: 1
2026-03-28 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Scrape type for WN54122: 1
2026-03-28 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:18 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Scrape type for WM28184: 2
2026-03-28 08:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-28 08:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e25ca2-9a89-529b-8fd6-fac12f04e25f with scrape type 2
2026-03-28 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e25ca2-9a89-529b-8fd6-fac12f04e25f with scrape type 2
2026-03-28 08:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70e25ca2-9a89-529b-8fd6-fac12f04e25f, identifier: WM28184
2026-03-28 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-28 08:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184 to the API
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:25Z',
 'fuel_type': 'petrol',
 'id': '70e25ca2-9a89-529b-8fd6-fac12f04e25f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM28184',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 201750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2018}
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-28 08:35:18 [auto1.be] INFO: Saving data for WM28184: {'auction_closing_time': 1774882885.0, 'created_time': 1774384578.475275, 'last_price_update_time': 1774686918.927299}
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM28184') HTTP/1.1" 204 0
2026-03-28 08:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:19 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-28 08:35:19 [auto1.be] INFO: Scrape type for UA48921: 1
2026-03-28 08:35:19 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 08:35:19 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-28 08:35:19 [auto1.be] INFO: Scrape type for LE69336: 2
2026-03-28 08:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-28 08:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with scrape type 2
2026-03-28 08:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with scrape type 2
2026-03-28 08:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9, identifier: LE69336
2026-03-28 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-28 08:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336 to the API
2026-03-28 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'diesel',
 'id': '3d24c770-d34a-5cfb-9daa-86d53d2b05a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69336',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 378167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-01',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Saving data for LE69336: {'auction_closing_time': 1774885180.0, 'created_time': 1773920168.94634, 'last_price_update_time': 1774686920.397504}
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE69336') HTTP/1.1" 204 0
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for RY49845: 1
2026-03-28 08:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF70513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for ZT87936: 1
2026-03-28 08:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for VZ26828: 1
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for KR16689: 1
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for YV20290: 1
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: EP21660
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for LK52725: 1
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for TS84713: 1
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for HY97997: 1
2026-03-28 08:35:20 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 08:35:20 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-28 08:35:20 [auto1.be] INFO: Scrape type for ZU52155: 2
2026-03-28 08:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-28 08:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with scrape type 2
2026-03-28 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with scrape type 2
2026-03-28 08:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198, identifier: ZU52155
2026-03-28 08:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-28 08:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-28 08:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155 to the API
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:22:58Z',
 'fuel_type': 'diesel',
 'id': 'e2f34d93-eaf8-5527-b8e0-3b3f9b29f198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU52155',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 184666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-07',
 'seller_name': None,
 'title': 'BMW X3 xDrive 18d Edition Exclusive',
 'transmission': 'manual',
 'trim': 'Edition Exclusive',
 'year': 2010}
2026-03-28 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-28 08:35:21 [auto1.be] INFO: Saving data for ZU52155: {'auction_closing_time': 1774884178.0, 'created_time': 1774039028.863284, 'last_price_update_time': 1774686921.059323}
2026-03-28 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU52155') HTTP/1.1" 204 0
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Scrape type for FY94559: 2
2026-03-28 08:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-28 08:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with scrape type 2
2026-03-28 08:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with scrape type 2
2026-03-28 08:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 603692b3-5c67-5f24-ac09-e0b8e7e230f6, identifier: FY94559
2026-03-28 08:35:22 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/TF70513/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 08:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-28 08:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-28 08:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559 to the API
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:37:57Z',
 'fuel_type': 'petrol',
 'id': '603692b3-5c67-5f24-ac09-e0b8e7e230f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY94559',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 86319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Saving data for FY94559: {'auction_closing_time': 1774885077.0, 'created_time': 1773953032.544082, 'last_price_update_time': 1774686922.600908}
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY94559') HTTP/1.1" 204 0
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-28 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN54122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Scrape type for BR73229: 1
2026-03-28 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG81228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW32127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE27208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC01829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD95004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-28 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Scrape type for BB63081: 1
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 08:35:22 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-28 08:35:22 [auto1.be] INFO: Scrape type for SD89253: 2
2026-03-28 08:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-28 08:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with scrape type 2
2026-03-28 08:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with scrape type 2
2026-03-28 08:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e, identifier: SD89253
2026-03-28 08:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-28 08:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-28 08:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253 to the API
2026-03-28 08:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:30:24Z',
 'fuel_type': 'petrol',
 'id': '8a5f59a8-f8ff-5e75-a341-3cc401653c6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD89253',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 132264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2017}
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Saving data for SD89253: {'auction_closing_time': 1774884624.0, 'created_time': 1773995750.214786, 'last_price_update_time': 1774686923.138282}
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD89253') HTTP/1.1" 204 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: EP21660
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-28 08:35:23 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-28 08:35:23 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY49845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA48921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV20290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY97997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT87936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR16689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK52725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS84713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF70513> (referer: https://www.auto1.com/v1/car-details-view/TF70513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-28 08:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with scrape type 1
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_bb6eaa049791e23cfcf9a514f1e64e9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_bb6eaa049791e23cfcf9a514f1e64e9e.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_3891050b2f54ac7f0a351f26f3d0615e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_3891050b2f54ac7f0a351f26f3d0615e.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_2bafe2834aa34ed98e428e2603862ac1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2bafe2834aa34ed98e428e2603862ac1.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_fd4babe270ac10c6404dc555a1375121.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_fd4babe270ac10c6404dc555a1375121.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_b84e76b8a9c176bb019ee312a792e190.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_b84e76b8a9c176bb019ee312a792e190.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_2162107da365f0107f620c396d4a8078.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2162107da365f0107f620c396d4a8078.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_cf55c6af40f7f6922e462f32ecdab707.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_cf55c6af40f7f6922e462f32ecdab707.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_ba753f2ff75818d2d716cda992422bc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_ba753f2ff75818d2d716cda992422bc2.jpg not downloaded yet
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_7cfca4bc09c14d8c986bca3cfdf81ded.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_7cfca4bc09c14d8c986bca3cfdf81ded.jpg not downloaded yet
2026-03-28 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for XR93319: 1
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for PX22691: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for BA79285: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for ZH21985: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for WX93406: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for TU23478: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for NH68811: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for SK39898: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for NY11434: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for XE88192: 0
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 08:35:25 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [auto1.be] INFO: Scrape type for FU55081: 0
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR73229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD95004> (referer: https://www.auto1.com/v1/car-details-view/ZD95004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ26828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB63081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC01829> (referer: https://www.auto1.com/v1/car-details-view/PC01829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-28 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with scrape type 1
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_5da16a88294499b9995d305c0b7cc363.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_5da16a88294499b9995d305c0b7cc363.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_4061cc41572491ff694e0e91f34128c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_4061cc41572491ff694e0e91f34128c9.jpg not downloaded yet
2026-03-28 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-28 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5fb589-9951-5f71-991b-a5e438cec510 with scrape type 1
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_7b13375d3c2d0ee899c592b16241129c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7b13375d3c2d0ee899c592b16241129c.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_8f8fe5f884c12abafbdd1485bb61c57e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8f8fe5f884c12abafbdd1485bb61c57e.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_7260e903dc10d0d611863336f3c7fb9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7260e903dc10d0d611863336f3c7fb9a.jpg not downloaded yet
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE27208> (referer: https://www.auto1.com/v1/car-details-view/CE27208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_7cfca4bc09c14d8c986bca3cfdf81ded.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_eecd35067b7b4274ef0e56a7a9a772e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_eecd35067b7b4274ef0e56a7a9a772e3.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_5bf73e7bde4d2f816c38313497f04cee.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_5bf73e7bde4d2f816c38313497f04cee.jpg not downloaded yet
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_8d9d18413f407c721bf21c49c1aafafa.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8d9d18413f407c721bf21c49c1aafafa.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_22d9e9eb51cf2babc53270bbc594ee54.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_22d9e9eb51cf2babc53270bbc594ee54.jpg not downloaded yet
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW32127> (referer: https://www.auto1.com/v1/car-details-view/RW32127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_9fd5c52378fd1f8bd6b45ca995a64471.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_9fd5c52378fd1f8bd6b45ca995a64471.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg not downloaded yet
2026-03-28 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_67b729fb6f16580ce0c0c24875c79628.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_67b729fb6f16580ce0c0c24875c79628.jpg not downloaded yet
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_c3b9e15c1d2d7366ae995f397126d7f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_c3b9e15c1d2d7366ae995f397126d7f7.jpg not downloaded yet
2026-03-28 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_cf55c6af40f7f6922e462f32ecdab707.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_1188ff8a1807bda088f0a6383e1ac537.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_1188ff8a1807bda088f0a6383e1ac537.jpg not downloaded yet
2026-03-28 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-28 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31345bdc-1875-5eb2-93ff-11d119f18053 with scrape type 1
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_2417423dc70b9de766f92ac19ca8690b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_2417423dc70b9de766f92ac19ca8690b.jpg not downloaded yet
2026-03-28 08:35:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 08:35:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 08:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d1d490>
2026-03-28 08:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_7cfca4bc09c14d8c986bca3cfdf81ded.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_7cfca4bc09c14d8c986bca3cfdf81ded.jpg saved to cache
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_c8a18d907eba05c6c117d0376ee14802.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_c8a18d907eba05c6c117d0376ee14802.jpg not downloaded yet
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_ae09f5cf81e92808ca48b6a4884cfba2.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_ae09f5cf81e92808ca48b6a4884cfba2.jpg not downloaded yet
2026-03-28 08:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7260e903dc10d0d611863336f3c7fb9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-28 08:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ebf1fc3-07be-5c12-9255-977e9814527d with scrape type 1
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ebf1fc3-07be-5c12-9255-977e9814527d
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_af97923bdf5c8cabd31f51fef448278a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_af97923bdf5c8cabd31f51fef448278a.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_3acfe20789f71c19ec4650c336d4c656.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_3acfe20789f71c19ec4650c336d4c656.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_495a65a0ec6ba3bddc3da4d3d4261058.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_495a65a0ec6ba3bddc3da4d3d4261058.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_9a021440f4af843c41760959cf06d3ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_9a021440f4af843c41760959cf06d3ad.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_d83c742ee6ccb6195d3007476974c900.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_d83c742ee6ccb6195d3007476974c900.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_fa8662a029f2b667e5151f4c0b3c3fb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_fa8662a029f2b667e5151f4c0b3c3fb1.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_2cba13d02b1602b835dd75f8c6b0a1a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_2cba13d02b1602b835dd75f8c6b0a1a2.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_fe250585364cdbfa327c091d1866a4c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_fe250585364cdbfa327c091d1866a4c3.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_f5c3c7197e57a353c3a581b71d5c8d87.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_f5c3c7197e57a353c3a581b71d5c8d87.jpg already downloaded
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F0c%252F780c7203f1e70edf7c24802bded30393%252Fpa%252FRW32127_a359050a9a9a15a8f963fcba155930bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_a359050a9a9a15a8f963fcba155930bb.jpg already downloaded
2026-03-28 08:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9ebf1fc3-07be-5c12-9255-977e9814527d, identifier: RW32127
2026-03-28 08:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc2bb590>
2026-03-28 08:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_cf55c6af40f7f6922e462f32ecdab707.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_cf55c6af40f7f6922e462f32ecdab707.jpg saved to cache
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_a74b81170bed19a027ad49514e2a965f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_a74b81170bed19a027ad49514e2a965f.jpg not downloaded yet
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_e1db4e4996c899bfbb6cc9508b10595d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_e1db4e4996c899bfbb6cc9508b10595d.jpg not downloaded yet
2026-03-28 08:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-28 08:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-28 08:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127 to the API
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RW32127>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:55:44Z',
 'fuel_type': 'diesel',
 'id': '9ebf1fc3-07be-5c12-9255-977e9814527d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW32127',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 436555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_af97923bdf5c8cabd31f51fef448278a.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_3acfe20789f71c19ec4650c336d4c656.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_495a65a0ec6ba3bddc3da4d3d4261058.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_9a021440f4af843c41760959cf06d3ad.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_d83c742ee6ccb6195d3007476974c900.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_fa8662a029f2b667e5151f4c0b3c3fb1.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_2cba13d02b1602b835dd75f8c6b0a1a2.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_fe250585364cdbfa327c091d1866a4c3.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_f5c3c7197e57a353c3a581b71d5c8d87.jpg',
                'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_a359050a9a9a15a8f963fcba155930bb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_af97923bdf5c8cabd31f51fef448278a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_3acfe20789f71c19ec4650c336d4c656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_495a65a0ec6ba3bddc3da4d3d4261058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_9a021440f4af843c41760959cf06d3ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_d83c742ee6ccb6195d3007476974c900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_fa8662a029f2b667e5151f4c0b3c3fb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_2cba13d02b1602b835dd75f8c6b0a1a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_fe250585364cdbfa327c091d1866a4c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_f5c3c7197e57a353c3a581b71d5c8d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ebf1fc3-07be-5c12-9255-977e9814527d/9ebf1fc3-07be-5c12-9255-977e9814527d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/0c/780c7203f1e70edf7c24802bded30393/pa/RW32127_a359050a9a9a15a8f963fcba155930bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2012}
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-28 08:35:26 [auto1.be] INFO: Saving data for RW32127: {'created_time': 1774686926.891323, 'last_price_update_time': 1774686926.891333, 'auction_closing_time': 1774886144.0}
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW32127') HTTP/1.1" 204 0
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_c3b9e15c1d2d7366ae995f397126d7f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_212a60ce32ca38d77995d2a3d5b63e1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_212a60ce32ca38d77995d2a3d5b63e1f.jpg not downloaded yet
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc080550>
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_7260e903dc10d0d611863336f3c7fb9a.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7260e903dc10d0d611863336f3c7fb9a.jpg saved to cache
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY97997> (referer: https://www.auto1.com/v1/car-details-view/HY97997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA48921> (referer: https://www.auto1.com/v1/car-details-view/UA48921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG81228> (referer: https://www.auto1.com/v1/car-details-view/CG81228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN54122> (referer: https://www.auto1.com/v1/car-details-view/WN54122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV20290> (referer: https://www.auto1.com/v1/car-details-view/YV20290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_fa400a1a33600e09bc89b8f01b8e061c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_fa400a1a33600e09bc89b8f01b8e061c.jpg not downloaded yet
2026-03-28 08:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg not downloaded yet
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_b63a7544c4e67af71c518a7264151309.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_b63a7544c4e67af71c518a7264151309.jpg not downloaded yet
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d7e650>
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_c3b9e15c1d2d7366ae995f397126d7f7.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_c3b9e15c1d2d7366ae995f397126d7f7.jpg saved to cache
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_f8f6d5d0214063c6f055489227d6fdaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_f8f6d5d0214063c6f055489227d6fdaf.jpg not downloaded yet
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_161531624aefb0eb4b1eec66a1c47857.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_161531624aefb0eb4b1eec66a1c47857.jpg not downloaded yet
2026-03-28 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8f8fe5f884c12abafbdd1485bb61c57e.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_78171ba08b54d889b355ca99c2afe425.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_78171ba08b54d889b355ca99c2afe425.jpg not downloaded yet
2026-03-28 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-28 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 with scrape type 1
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_b9a220ac8def29418432e4e11845c9d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_b9a220ac8def29418432e4e11845c9d3.jpg not downloaded yet
2026-03-28 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-28 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a20b8a-8294-554b-9300-021f075da908 with scrape type 1
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2a20b8a-8294-554b-9300-021f075da908
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_2d34c7752e8000a405e90e8114a1b59e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_2d34c7752e8000a405e90e8114a1b59e.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_2fe48f414bfd243fd5ec7c6d17c8a41b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_2fe48f414bfd243fd5ec7c6d17c8a41b.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_9f327cd3ca26da70a3125af42095948a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_9f327cd3ca26da70a3125af42095948a.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_a6ef73060abb091688158bcccaed0712.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_a6ef73060abb091688158bcccaed0712.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_eb4fec9a944d97a34c2e7a0a952d5835.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_eb4fec9a944d97a34c2e7a0a952d5835.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_819f72328e58b995a12923b100dcf46d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_819f72328e58b995a12923b100dcf46d.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_b0906f24197968d23dff916edccd95c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_b0906f24197968d23dff916edccd95c4.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_562ad33f8b1281b4521eb77e2f88519a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_562ad33f8b1281b4521eb77e2f88519a.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_dd6cbf94e6a30037519e4fb1fad56f3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_dd6cbf94e6a30037519e4fb1fad56f3b.jpg already downloaded
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F37%252Ffb37cdd5383a69197defb2d913d41baa%252Fpa%252FUA48921_7994fa8f3ef202f5597cfa4fad5fff1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_7994fa8f3ef202f5597cfa4fad5fff1c.jpg already downloaded
2026-03-28 08:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2a20b8a-8294-554b-9300-021f075da908, identifier: UA48921
2026-03-28 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-28 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373d6282-31c7-562e-b795-e7d228f92fa1 with scrape type 1
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_2700c1c34531377bfd7879388e8dd44e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2700c1c34531377bfd7879388e8dd44e.jpg not downloaded yet
2026-03-28 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-28 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56cb8fa-524f-5248-8e48-8957f14682fa with scrape type 1
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_17a608626ac86bb9e464af0dce98af8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_17a608626ac86bb9e464af0dce98af8f.jpg not downloaded yet
2026-03-28 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-28 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce43ba4-977e-5060-b67e-9faba728d3a9 with scrape type 1
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_d371ef08b35d391fb238f5e686b546ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_d371ef08b35d391fb238f5e686b546ed.jpg not downloaded yet
2026-03-28 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-28 08:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921 to the API
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA48921>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'petrol',
 'id': 'b2a20b8a-8294-554b-9300-021f075da908',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA48921',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 76342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_2d34c7752e8000a405e90e8114a1b59e.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_2fe48f414bfd243fd5ec7c6d17c8a41b.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_9f327cd3ca26da70a3125af42095948a.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_a6ef73060abb091688158bcccaed0712.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_eb4fec9a944d97a34c2e7a0a952d5835.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_819f72328e58b995a12923b100dcf46d.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_b0906f24197968d23dff916edccd95c4.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_562ad33f8b1281b4521eb77e2f88519a.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_dd6cbf94e6a30037519e4fb1fad56f3b.jpg',
                'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_7994fa8f3ef202f5597cfa4fad5fff1c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_2d34c7752e8000a405e90e8114a1b59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_2fe48f414bfd243fd5ec7c6d17c8a41b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_9f327cd3ca26da70a3125af42095948a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_a6ef73060abb091688158bcccaed0712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_eb4fec9a944d97a34c2e7a0a952d5835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_819f72328e58b995a12923b100dcf46d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_b0906f24197968d23dff916edccd95c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_562ad33f8b1281b4521eb77e2f88519a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_dd6cbf94e6a30037519e4fb1fad56f3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a20b8a-8294-554b-9300-021f075da908/b2a20b8a-8294-554b-9300-021f075da908_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/37/fb37cdd5383a69197defb2d913d41baa/pa/UA48921_7994fa8f3ef202f5597cfa4fad5fff1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pulse',
 'year': 2013}
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [auto1.be] INFO: Saving data for UA48921: {'created_time': 1774686928.061024, 'last_price_update_time': 1774686928.061036, 'auction_closing_time': 1774886218.0}
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA48921') HTTP/1.1" 204 0
2026-03-28 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_22d9e9eb51cf2babc53270bbc594ee54.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_e26d410d602b319ef57fd8151658f198.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e26d410d602b319ef57fd8151658f198.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_2fa1a87ec35a2c1ff5af383173c94339.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2fa1a87ec35a2c1ff5af383173c94339.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_9f81374155a1e54ffb036645ff5b4ce6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_9f81374155a1e54ffb036645ff5b4ce6.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_83404549f42b567b1903f95994e57ce5.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_83404549f42b567b1903f95994e57ce5.jpg not downloaded yet
2026-03-28 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_e1db4e4996c899bfbb6cc9508b10595d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY49845> (referer: https://www.auto1.com/v1/car-details-view/RY49845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_ae09f5cf81e92808ca48b6a4884cfba2.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_5015c880117f7e46a3f220f4c73e8f70.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5015c880117f7e46a3f220f4c73e8f70.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_9c4c3c555ba18f81c7e1c95196c2109c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_9c4c3c555ba18f81c7e1c95196c2109c.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_28c698622627eca284a77f584da50224.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_28c698622627eca284a77f584da50224.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg not downloaded yet
2026-03-28 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR16689> (referer: https://www.auto1.com/v1/car-details-view/KR16689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d763d0>
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_8f8fe5f884c12abafbdd1485bb61c57e.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8f8fe5f884c12abafbdd1485bb61c57e.jpg saved to cache
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_fc1997414d195aa9afc4e27abcd4f493.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_fc1997414d195aa9afc4e27abcd4f493.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_a252a11c9de010b79b1cf4fd1a478dc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_a252a11c9de010b79b1cf4fd1a478dc6.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_2245fc68ac1fa61d0937aaae50de13e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_2245fc68ac1fa61d0937aaae50de13e1.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_37654602409d3169f88a64a9d48934cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_37654602409d3169f88a64a9d48934cb.jpg not downloaded yet
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d39310>
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_22d9e9eb51cf2babc53270bbc594ee54.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_22d9e9eb51cf2babc53270bbc594ee54.jpg saved to cache
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d45a90>
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_e1db4e4996c899bfbb6cc9508b10595d.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_e1db4e4996c899bfbb6cc9508b10595d.jpg saved to cache
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-28 08:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 683c5982-2d40-5e4c-8362-4eea5e187da1 with scrape type 1
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 683c5982-2d40-5e4c-8362-4eea5e187da1
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_c951cb82542f2e098ecde9c392588992.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c951cb82542f2e098ecde9c392588992.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_90ebdb82f9471430b30d19628c194243.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_90ebdb82f9471430b30d19628c194243.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_c4795c4c0efbcffdc8f46f33f1d3ef85.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c4795c4c0efbcffdc8f46f33f1d3ef85.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_2b6ff275ef875fdae8fec860bc5b7cfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_2b6ff275ef875fdae8fec860bc5b7cfb.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_ca9c675519d22555002e428321565cc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_ca9c675519d22555002e428321565cc3.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_19b12e294125e3935096ff93161c5385.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_19b12e294125e3935096ff93161c5385.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_5f7d217df2721477cad2360b57c75d33.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_5f7d217df2721477cad2360b57c75d33.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_12fd811df91b997cd96ec395f2e4233a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_12fd811df91b997cd96ec395f2e4233a.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_c423386ab241b83337ae2effe49fd71f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c423386ab241b83337ae2effe49fd71f.jpg already downloaded
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe7%252Faae70dc9863ada24d28a3d8d3fa91fa1%252Fpa%252FRY49845_ab44d137fd8859dbd28cc2fa414c68c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_ab44d137fd8859dbd28cc2fa414c68c0.jpg already downloaded
2026-03-28 08:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 683c5982-2d40-5e4c-8362-4eea5e187da1, identifier: RY49845
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0d7410>
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_ae09f5cf81e92808ca48b6a4884cfba2.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_ae09f5cf81e92808ca48b6a4884cfba2.jpg saved to cache
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_212a60ce32ca38d77995d2a3d5b63e1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_e6b6747d09f7d4f7bebf8b558f25acca.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e6b6747d09f7d4f7bebf8b558f25acca.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_d1b35997164278bfdeddb633e691162b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_d1b35997164278bfdeddb633e691162b.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_8f18580f79dcfe6a2a0f34812b1c30f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_8f18580f79dcfe6a2a0f34812b1c30f4.jpg not downloaded yet
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_4689a549794bb1cc6ff7bffc829449cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_4689a549794bb1cc6ff7bffc829449cd.jpg not downloaded yet
2026-03-28 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-28 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845 to the API
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY49845>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:55Z',
 'fuel_type': 'petrol',
 'id': '683c5982-2d40-5e4c-8362-4eea5e187da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY49845',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '4er',
 'odometer': 60888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c951cb82542f2e098ecde9c392588992.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_90ebdb82f9471430b30d19628c194243.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c4795c4c0efbcffdc8f46f33f1d3ef85.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_2b6ff275ef875fdae8fec860bc5b7cfb.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_ca9c675519d22555002e428321565cc3.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_19b12e294125e3935096ff93161c5385.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_5f7d217df2721477cad2360b57c75d33.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_12fd811df91b997cd96ec395f2e4233a.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c423386ab241b83337ae2effe49fd71f.jpg',
                'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_ab44d137fd8859dbd28cc2fa414c68c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c951cb82542f2e098ecde9c392588992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_90ebdb82f9471430b30d19628c194243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c4795c4c0efbcffdc8f46f33f1d3ef85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_2b6ff275ef875fdae8fec860bc5b7cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_ca9c675519d22555002e428321565cc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_19b12e294125e3935096ff93161c5385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_5f7d217df2721477cad2360b57c75d33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_12fd811df91b997cd96ec395f2e4233a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_c423386ab241b83337ae2effe49fd71f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_683c5982-2d40-5e4c-8362-4eea5e187da1/683c5982-2d40-5e4c-8362-4eea5e187da1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/e7/aae70dc9863ada24d28a3d8d3fa91fa1/pa/RY49845_ab44d137fd8859dbd28cc2fa414c68c0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [auto1.be] INFO: Saving data for RY49845: {'created_time': 1774686929.340394, 'last_price_update_time': 1774686929.340404, 'auction_closing_time': 1774883875.0}
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY49845') HTTP/1.1" 204 0
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_161531624aefb0eb4b1eec66a1c47857.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_1188ff8a1807bda088f0a6383e1ac537.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_6ac4211e21d2f96cdeedd96ad1d18b20.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6ac4211e21d2f96cdeedd96ad1d18b20.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_7881ab899a132ec88e31759a1c1129e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_7881ab899a132ec88e31759a1c1129e7.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_e002871478a949612bd41c04a19ff84f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_e002871478a949612bd41c04a19ff84f.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_612771ee8d239ec5ff44f34150ac5d6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_612771ee8d239ec5ff44f34150ac5d6b.jpg not downloaded yet
2026-03-28 08:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-28 08:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964e5527-b132-5e5b-82b9-2780fb02e37f with scrape type 1
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_15e6a15cc4a47c37f715e36d85543156.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_15e6a15cc4a47c37f715e36d85543156.jpg not downloaded yet
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR93319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_15b3e2dcc45348cf49d2dd4895ead0c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_15b3e2dcc45348cf49d2dd4895ead0c8.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_a9dd9427605db5ff8133026d06fbbac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_a9dd9427605db5ff8133026d06fbbac0.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_baa11a3d2be168d53d5aed039ba40ec6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_baa11a3d2be168d53d5aed039ba40ec6.jpg not downloaded yet
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b648fcd0>
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_212a60ce32ca38d77995d2a3d5b63e1f.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_212a60ce32ca38d77995d2a3d5b63e1f.jpg saved to cache
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_d371ef08b35d391fb238f5e686b546ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_5ae6edf4325e77f8e8bf315d03232b4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5ae6edf4325e77f8e8bf315d03232b4b.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_b36d812a204efe1a4c5e60fe0df6a8bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_b36d812a204efe1a4c5e60fe0df6a8bc.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_4c9dc86a10d017adefc43649082eae2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_4c9dc86a10d017adefc43649082eae2d.jpg not downloaded yet
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc07dc90>
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_161531624aefb0eb4b1eec66a1c47857.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_161531624aefb0eb4b1eec66a1c47857.jpg saved to cache
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc07f310>
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_1188ff8a1807bda088f0a6383e1ac537.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_1188ff8a1807bda088f0a6383e1ac537.jpg saved to cache
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_ba753f2ff75818d2d716cda992422bc2.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_83404549f42b567b1903f95994e57ce5.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_6caf4f0d200fe7d9ddefb96a8fc5b5e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6caf4f0d200fe7d9ddefb96a8fc5b5e1.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_dd83e20bfd3f4099c723a0207976ccb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_dd83e20bfd3f4099c723a0207976ccb8.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_d1b61edbd87b7ab8d86c4397a9b80e12.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_d1b61edbd87b7ab8d86c4397a9b80e12.jpg not downloaded yet
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_9f81374155a1e54ffb036645ff5b4ce6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6413850>
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_d371ef08b35d391fb238f5e686b546ed.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_d371ef08b35d391fb238f5e686b546ed.jpg saved to cache
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_aedace3e12e1068fa6735cae9df2a763.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_aedace3e12e1068fa6735cae9df2a763.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_159e66093e69e0e635e7adc5b7c52913.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_159e66093e69e0e635e7adc5b7c52913.jpg not downloaded yet
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_ff8fc84624b21a1780e97528aea2d16f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_ff8fc84624b21a1780e97528aea2d16f.jpg not downloaded yet
2026-03-28 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2162107da365f0107f620c396d4a8078.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_3c5824410bfc81a3f8731f9f5d04b3f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_3c5824410bfc81a3f8731f9f5d04b3f0.jpg not downloaded yet
2026-03-28 08:35:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6eec710>
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_ba753f2ff75818d2d716cda992422bc2.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_ba753f2ff75818d2d716cda992422bc2.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6fbded0>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_83404549f42b567b1903f95994e57ce5.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_83404549f42b567b1903f95994e57ce5.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2fa1a87ec35a2c1ff5af383173c94339.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_4689a549794bb1cc6ff7bffc829449cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e26d410d602b319ef57fd8151658f198.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_37654602409d3169f88a64a9d48934cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_422e7411a30083aa9f7b5afde561a5b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_422e7411a30083aa9f7b5afde561a5b6.jpg not downloaded yet
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f93650>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_9f81374155a1e54ffb036645ff5b4ce6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_9f81374155a1e54ffb036645ff5b4ce6.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f93790>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_2162107da365f0107f620c396d4a8078.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2162107da365f0107f620c396d4a8078.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_15e6a15cc4a47c37f715e36d85543156.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_183c2523e3aaa2f02d2aea1269835314.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_183c2523e3aaa2f02d2aea1269835314.jpg not downloaded yet
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_baa11a3d2be168d53d5aed039ba40ec6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_4c9dc86a10d017adefc43649082eae2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_b20c1ff75cd524d4928dd09779aea1f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_b20c1ff75cd524d4928dd09779aea1f6.jpg not downloaded yet
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_0dfcfdc063b59503f0892c2106e793c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_0dfcfdc063b59503f0892c2106e793c8.jpg not downloaded yet
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0a2d10>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_2fa1a87ec35a2c1ff5af383173c94339.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2fa1a87ec35a2c1ff5af383173c94339.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0d8fd0>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_4689a549794bb1cc6ff7bffc829449cd.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_4689a549794bb1cc6ff7bffc829449cd.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6497c90>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_e26d410d602b319ef57fd8151658f198.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e26d410d602b319ef57fd8151658f198.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0da190>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_37654602409d3169f88a64a9d48934cb.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_37654602409d3169f88a64a9d48934cb.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_8f18580f79dcfe6a2a0f34812b1c30f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_3c5824410bfc81a3f8731f9f5d04b3f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_ff8fc84624b21a1780e97528aea2d16f.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_2417423dc70b9de766f92ac19ca8690b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_b36d812a204efe1a4c5e60fe0df6a8bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5ae6edf4325e77f8e8bf315d03232b4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6e0bfd0>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_15e6a15cc4a47c37f715e36d85543156.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_15e6a15cc4a47c37f715e36d85543156.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6441790>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_baa11a3d2be168d53d5aed039ba40ec6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_baa11a3d2be168d53d5aed039ba40ec6.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f10f90>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_4c9dc86a10d017adefc43649082eae2d.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_4c9dc86a10d017adefc43649082eae2d.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_159e66093e69e0e635e7adc5b7c52913.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_422e7411a30083aa9f7b5afde561a5b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_d1b61edbd87b7ab8d86c4397a9b80e12.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_aedace3e12e1068fa6735cae9df2a763.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_dd83e20bfd3f4099c723a0207976ccb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_0dfcfdc063b59503f0892c2106e793c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0a9f50>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_8f18580f79dcfe6a2a0f34812b1c30f4.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_8f18580f79dcfe6a2a0f34812b1c30f4.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0c7c10>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_3c5824410bfc81a3f8731f9f5d04b3f0.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_3c5824410bfc81a3f8731f9f5d04b3f0.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6ddcb10>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_ff8fc84624b21a1780e97528aea2d16f.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_ff8fc84624b21a1780e97528aea2d16f.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0c6890>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_2417423dc70b9de766f92ac19ca8690b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_2417423dc70b9de766f92ac19ca8690b.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc557fd0>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_b36d812a204efe1a4c5e60fe0df6a8bc.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_b36d812a204efe1a4c5e60fe0df6a8bc.jpg saved to cache
2026-03-28 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0c44d0>
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_5ae6edf4325e77f8e8bf315d03232b4b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5ae6edf4325e77f8e8bf315d03232b4b.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f7a8d0>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_159e66093e69e0e635e7adc5b7c52913.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_159e66093e69e0e635e7adc5b7c52913.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bcea5810>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_422e7411a30083aa9f7b5afde561a5b6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_422e7411a30083aa9f7b5afde561a5b6.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0bf210>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_d1b61edbd87b7ab8d86c4397a9b80e12.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_d1b61edbd87b7ab8d86c4397a9b80e12.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc080910>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_aedace3e12e1068fa6735cae9df2a763.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_aedace3e12e1068fa6735cae9df2a763.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bd165390>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_dd83e20bfd3f4099c723a0207976ccb8.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_dd83e20bfd3f4099c723a0207976ccb8.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc083910>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_0dfcfdc063b59503f0892c2106e793c8.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_0dfcfdc063b59503f0892c2106e793c8.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_b20c1ff75cd524d4928dd09779aea1f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_183c2523e3aaa2f02d2aea1269835314.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_a9dd9427605db5ff8133026d06fbbac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_15b3e2dcc45348cf49d2dd4895ead0c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_612771ee8d239ec5ff44f34150ac5d6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK52725> (referer: https://www.auto1.com/v1/car-details-view/LK52725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6caf4f0d200fe7d9ddefb96a8fc5b5e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_a74b81170bed19a027ad49514e2a965f.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_c8a18d907eba05c6c117d0376ee14802.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_e002871478a949612bd41c04a19ff84f.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_7881ab899a132ec88e31759a1c1129e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_a252a11c9de010b79b1cf4fd1a478dc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6eedb50>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_b20c1ff75cd524d4928dd09779aea1f6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_b20c1ff75cd524d4928dd09779aea1f6.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d2d650>
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fb6%252F64b653bb7ee4ba80efcfeefefff0f220%252Fpa%252FKR16689_183c2523e3aaa2f02d2aea1269835314.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_183c2523e3aaa2f02d2aea1269835314.jpg saved to cache
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 964e5527-b132-5e5b-82b9-2780fb02e37f
2026-03-28 08:35:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 964e5527-b132-5e5b-82b9-2780fb02e37f, skipping ID generation
2026-03-28 08:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964e5527-b132-5e5b-82b9-2780fb02e37f with scrape type 1
2026-03-28 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 964e5527-b132-5e5b-82b9-2780fb02e37f sending to next pipeline
2026-03-28 08:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 964e5527-b132-5e5b-82b9-2780fb02e37f, identifier: KR16689
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR93319> (referer: https://www.auto1.com/v1/car-details-view/XR93319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-28 08:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-28 08:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689 to the API
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_183c2523e3aaa2f02d2aea1269835314.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:53:52Z',
 'fuel_type': 'petrol',
 'id': '964e5527-b132-5e5b-82b9-2780fb02e37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR16689',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 62290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40940,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_15e6a15cc4a47c37f715e36d85543156.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40230,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_baa11a3d2be168d53d5aed039ba40ec6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44973,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_4c9dc86a10d017adefc43649082eae2d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33607,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_d1b61edbd87b7ab8d86c4397a9b80e12.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40801,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_ff8fc84624b21a1780e97528aea2d16f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46936,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_3c5824410bfc81a3f8731f9f5d04b3f0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33539,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_422e7411a30083aa9f7b5afde561a5b6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47523,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_183c2523e3aaa2f02d2aea1269835314.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_b20c1ff75cd524d4928dd09779aea1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_964e5527-b132-5e5b-82b9-2780fb02e37f/964e5527-b132-5e5b-82b9-2780fb02e37f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/b6/64b653bb7ee4ba80efcfeefefff0f220/pa/KR16689_0dfcfdc063b59503f0892c2106e793c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2012}
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [auto1.be] INFO: Saving data for KR16689: {'created_time': 1774686932.349448, 'last_price_update_time': 1774686932.349458, 'auction_closing_time': 1774886032.0}
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR16689') HTTP/1.1" 204 0
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6ac4211e21d2f96cdeedd96ad1d18b20.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e6b6747d09f7d4f7bebf8b558f25acca.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_fc1997414d195aa9afc4e27abcd4f493.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc1368d0>
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_a9dd9427605db5ff8133026d06fbbac0.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_a9dd9427605db5ff8133026d06fbbac0.jpg saved to cache
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f4a0d0>
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_15b3e2dcc45348cf49d2dd4895ead0c8.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_15b3e2dcc45348cf49d2dd4895ead0c8.jpg saved to cache
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_28c698622627eca284a77f584da50224.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_9c4c3c555ba18f81c7e1c95196c2109c.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_d1b35997164278bfdeddb633e691162b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_2245fc68ac1fa61d0937aaae50de13e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6da4550>
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_612771ee8d239ec5ff44f34150ac5d6b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_612771ee8d239ec5ff44f34150ac5d6b.jpg saved to cache
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-28 08:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with scrape type 1
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c709fee6-adc9-56e0-acc0-7dbae4bf1e83
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_e0b7dc1b7bd0142a61e5bbe33727cd4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_e0b7dc1b7bd0142a61e5bbe33727cd4c.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_4ecb67e68fb827ec9bc9607c2515f7ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_4ecb67e68fb827ec9bc9607c2515f7ba.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_1b6849a7bed212dd4778ab1e0a284db5.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_1b6849a7bed212dd4778ab1e0a284db5.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_dfd1ec9afbc231f9bbf9db1ed6d6f34a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_dfd1ec9afbc231f9bbf9db1ed6d6f34a.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_b126918626f67e61d2353612e8dd65f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_b126918626f67e61d2353612e8dd65f7.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_bbd15fa6b49fcc79939cdfc9f16cc8cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_bbd15fa6b49fcc79939cdfc9f16cc8cd.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_0ce2bac1809a48cde9abdecc5e7a1cb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_0ce2bac1809a48cde9abdecc5e7a1cb8.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_74bd170d41b640a73ae0ca1fffd77d5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_74bd170d41b640a73ae0ca1fffd77d5e.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_ff631f752817c487d4d06c88f11a76cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_ff631f752817c487d4d06c88f11a76cb.jpg already downloaded
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d78af88f576895a99f80c16a142c09%252Fpa%252FLK52725_f6014a0c4c7c1d8c9cb337e01529e432.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_f6014a0c4c7c1d8c9cb337e01529e432.jpg already downloaded
2026-03-28 08:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c709fee6-adc9-56e0-acc0-7dbae4bf1e83, identifier: LK52725
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6484510>
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_6caf4f0d200fe7d9ddefb96a8fc5b5e1.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6caf4f0d200fe7d9ddefb96a8fc5b5e1.jpg saved to cache
2026-03-28 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d65e10>
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_a74b81170bed19a027ad49514e2a965f.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_a74b81170bed19a027ad49514e2a965f.jpg saved to cache
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0bc1d0>
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_c8a18d907eba05c6c117d0376ee14802.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_c8a18d907eba05c6c117d0376ee14802.jpg saved to cache
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d80910>
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_e002871478a949612bd41c04a19ff84f.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_e002871478a949612bd41c04a19ff84f.jpg saved to cache
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6ecf390>
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_7881ab899a132ec88e31759a1c1129e7.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_7881ab899a132ec88e31759a1c1129e7.jpg saved to cache
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d81790>
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_a252a11c9de010b79b1cf4fd1a478dc6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_a252a11c9de010b79b1cf4fd1a478dc6.jpg saved to cache
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-28 08:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b62383b5-6176-5c42-be88-764430464d31 with scrape type 1
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b62383b5-6176-5c42-be88-764430464d31
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_cd2615822f1b10109473cecf7973ce3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_cd2615822f1b10109473cecf7973ce3f.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_7fbc143d94a3e6d582ab9484f2703799.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_7fbc143d94a3e6d582ab9484f2703799.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_7a75061f48e3f97788c97aac440c34c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_7a75061f48e3f97788c97aac440c34c5.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_b98c753b34d4822371794b5562416396.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_b98c753b34d4822371794b5562416396.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_35dbd81cbf0ca4101d5751997817caa9.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_35dbd81cbf0ca4101d5751997817caa9.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_1081ba8cac6b83d2d36def705dcf0874.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_1081ba8cac6b83d2d36def705dcf0874.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_5811b5453a160718842f813473c824e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_5811b5453a160718842f813473c824e0.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_423f601bbd34546914b585c77cfa1f74.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_423f601bbd34546914b585c77cfa1f74.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_922c12a38684b2f081aea316099551f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_922c12a38684b2f081aea316099551f4.jpg already downloaded
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F25%252F44257ce7481f92c8298cf33fb54e1f1e%252Fpa%252FXR93319_5040db9aeab2c6c1095056f370dcd80c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_5040db9aeab2c6c1095056f370dcd80c.jpg already downloaded
2026-03-28 08:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b62383b5-6176-5c42-be88-764430464d31, identifier: XR93319
2026-03-28 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5015c880117f7e46a3f220f4c73e8f70.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-28 08:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-28 08:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725 to the API
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LK52725>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:02Z',
 'fuel_type': 'petrol',
 'id': 'c709fee6-adc9-56e0-acc0-7dbae4bf1e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK52725',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 71003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_e0b7dc1b7bd0142a61e5bbe33727cd4c.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_4ecb67e68fb827ec9bc9607c2515f7ba.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_1b6849a7bed212dd4778ab1e0a284db5.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_dfd1ec9afbc231f9bbf9db1ed6d6f34a.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_b126918626f67e61d2353612e8dd65f7.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_bbd15fa6b49fcc79939cdfc9f16cc8cd.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_0ce2bac1809a48cde9abdecc5e7a1cb8.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_74bd170d41b640a73ae0ca1fffd77d5e.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_ff631f752817c487d4d06c88f11a76cb.jpg',
                'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_f6014a0c4c7c1d8c9cb337e01529e432.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_e0b7dc1b7bd0142a61e5bbe33727cd4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_4ecb67e68fb827ec9bc9607c2515f7ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_1b6849a7bed212dd4778ab1e0a284db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_dfd1ec9afbc231f9bbf9db1ed6d6f34a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_b126918626f67e61d2353612e8dd65f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_bbd15fa6b49fcc79939cdfc9f16cc8cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_0ce2bac1809a48cde9abdecc5e7a1cb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_74bd170d41b640a73ae0ca1fffd77d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_ff631f752817c487d4d06c88f11a76cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c709fee6-adc9-56e0-acc0-7dbae4bf1e83/c709fee6-adc9-56e0-acc0-7dbae4bf1e83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d78af88f576895a99f80c16a142c09/pa/LK52725_f6014a0c4c7c1d8c9cb337e01529e432.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex 4x4',
 'year': 2013}
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-28 08:35:34 [auto1.be] INFO: Saving data for LK52725: {'created_time': 1774686934.060481, 'last_price_update_time': 1774686934.06049, 'auction_closing_time': 1774882802.0}
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK52725') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-28 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-28 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319 to the API
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR93319>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:18Z',
 'fuel_type': 'petrol',
 'id': 'b62383b5-6176-5c42-be88-764430464d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR93319',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 53451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_cd2615822f1b10109473cecf7973ce3f.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_7fbc143d94a3e6d582ab9484f2703799.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_7a75061f48e3f97788c97aac440c34c5.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_b98c753b34d4822371794b5562416396.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_35dbd81cbf0ca4101d5751997817caa9.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_1081ba8cac6b83d2d36def705dcf0874.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_5811b5453a160718842f813473c824e0.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_423f601bbd34546914b585c77cfa1f74.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_922c12a38684b2f081aea316099551f4.jpg',
                'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_5040db9aeab2c6c1095056f370dcd80c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_cd2615822f1b10109473cecf7973ce3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_7fbc143d94a3e6d582ab9484f2703799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_7a75061f48e3f97788c97aac440c34c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_b98c753b34d4822371794b5562416396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_35dbd81cbf0ca4101d5751997817caa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_1081ba8cac6b83d2d36def705dcf0874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_5811b5453a160718842f813473c824e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_423f601bbd34546914b585c77cfa1f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_922c12a38684b2f081aea316099551f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62383b5-6176-5c42-be88-764430464d31/b62383b5-6176-5c42-be88-764430464d31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/25/44257ce7481f92c8298cf33fb54e1f1e/pa/XR93319_5040db9aeab2c6c1095056f370dcd80c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-28 08:35:34 [auto1.be] INFO: Saving data for XR93319: {'created_time': 1774686934.420746, 'last_price_update_time': 1774686934.420756, 'auction_closing_time': 1774884858.0}
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR93319') HTTP/1.1" 204 0
2026-03-28 08:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_17a608626ac86bb9e464af0dce98af8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b644fa10>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa8%252Feaa828c5d87c540c272cbe0983ad8165%252Fpa%252FYV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dce43ba4-977e-5060-b67e-9faba728d3a9
2026-03-28 08:35:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dce43ba4-977e-5060-b67e-9faba728d3a9, skipping ID generation
2026-03-28 08:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce43ba4-977e-5060-b67e-9faba728d3a9 with scrape type 1
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dce43ba4-977e-5060-b67e-9faba728d3a9 sending to next pipeline
2026-03-28 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dce43ba4-977e-5060-b67e-9faba728d3a9, identifier: YV20290
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc554550>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_6ac4211e21d2f96cdeedd96ad1d18b20.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6ac4211e21d2f96cdeedd96ad1d18b20.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f924d0>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_e6b6747d09f7d4f7bebf8b558f25acca.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e6b6747d09f7d4f7bebf8b558f25acca.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f43d50>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_fc1997414d195aa9afc4e27abcd4f493.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_fc1997414d195aa9afc4e27abcd4f493.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b644d110>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_28c698622627eca284a77f584da50224.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_28c698622627eca284a77f584da50224.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d5ea10>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_9c4c3c555ba18f81c7e1c95196c2109c.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_9c4c3c555ba18f81c7e1c95196c2109c.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc5573d0>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_d1b35997164278bfdeddb633e691162b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_d1b35997164278bfdeddb633e691162b.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f40050>
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_2245fc68ac1fa61d0937aaae50de13e1.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_2245fc68ac1fa61d0937aaae50de13e1.jpg saved to cache
2026-03-28 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-28 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-28 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290 to the API
2026-03-28 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:24:19Z',
 'fuel_type': 'diesel',
 'id': 'dce43ba4-977e-5060-b67e-9faba728d3a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV20290',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 169718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_d371ef08b35d391fb238f5e686b546ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_83404549f42b567b1903f95994e57ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_c2502d4c2aad6c2820c9241e5665c34b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_37654602409d3169f88a64a9d48934cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_4689a549794bb1cc6ff7bffc829449cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_612771ee8d239ec5ff44f34150ac5d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_a9dd9427605db5ff8133026d06fbbac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_b36d812a204efe1a4c5e60fe0df6a8bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_dd83e20bfd3f4099c723a0207976ccb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce43ba4-977e-5060-b67e-9faba728d3a9/dce43ba4-977e-5060-b67e-9faba728d3a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a8/eaa828c5d87c540c272cbe0983ad8165/pa/YV20290_159e66093e69e0e635e7adc5b7c52913.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Business +',
 'transmission': 'manual',
 'trim': 'Business +',
 'year': 2019}
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-28 08:35:35 [auto1.be] INFO: Saving data for YV20290: {'created_time': 1774686935.285926, 'last_price_update_time': 1774686935.285938, 'auction_closing_time': 1774884259.0}
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV20290') HTTP/1.1" 204 0
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64ea310>
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_5015c880117f7e46a3f220f4c73e8f70.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5015c880117f7e46a3f220f4c73e8f70.jpg saved to cache
2026-03-28 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bd148550>
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F13%252F571333e269c8b1f9af80e954b027dab9%252Fpa%252FWN54122_17a608626ac86bb9e464af0dce98af8f.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_17a608626ac86bb9e464af0dce98af8f.jpg saved to cache
2026-03-28 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f56cb8fa-524f-5248-8e48-8957f14682fa
2026-03-28 08:35:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f56cb8fa-524f-5248-8e48-8957f14682fa, skipping ID generation
2026-03-28 08:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56cb8fa-524f-5248-8e48-8957f14682fa with scrape type 1
2026-03-28 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f56cb8fa-524f-5248-8e48-8957f14682fa sending to next pipeline
2026-03-28 08:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f56cb8fa-524f-5248-8e48-8957f14682fa, identifier: WN54122
2026-03-28 08:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-28 08:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-28 08:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122 to the API
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_17a608626ac86bb9e464af0dce98af8f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'diesel',
 'id': 'f56cb8fa-524f-5248-8e48-8957f14682fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN54122',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 295205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_17a608626ac86bb9e464af0dce98af8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_9f81374155a1e54ffb036645ff5b4ce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_28c698622627eca284a77f584da50224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_2245fc68ac1fa61d0937aaae50de13e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_8f18580f79dcfe6a2a0f34812b1c30f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f56cb8fa-524f-5248-8e48-8957f14682fa/f56cb8fa-524f-5248-8e48-8957f14682fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/13/571333e269c8b1f9af80e954b027dab9/pa/WN54122_e002871478a949612bd41c04a19ff84f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V50 1.6 DRIVe',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-28 08:35:36 [auto1.be] INFO: Saving data for WN54122: {'created_time': 1774686936.04424, 'last_price_update_time': 1774686936.044251, 'auction_closing_time': 1774884516.0}
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN54122') HTTP/1.1" 204 0
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_b63a7544c4e67af71c518a7264151309.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2700c1c34531377bfd7879388e8dd44e.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_b9a220ac8def29418432e4e11845c9d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_67b729fb6f16580ce0c0c24875c79628.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_fa400a1a33600e09bc89b8f01b8e061c.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_78171ba08b54d889b355ca99c2afe425.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_f8f6d5d0214063c6f055489227d6fdaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7b13375d3c2d0ee899c592b16241129c.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64e8810>
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_b63a7544c4e67af71c518a7264151309.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_b63a7544c4e67af71c518a7264151309.jpg saved to cache
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6da7dd0>
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb6%252F8eb63a2c827912a131481b0fda6f1abb%252Fpa%252FCG81228_2700c1c34531377bfd7879388e8dd44e.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2700c1c34531377bfd7879388e8dd44e.jpg saved to cache
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 373d6282-31c7-562e-b795-e7d228f92fa1
2026-03-28 08:35:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 373d6282-31c7-562e-b795-e7d228f92fa1, skipping ID generation
2026-03-28 08:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373d6282-31c7-562e-b795-e7d228f92fa1 with scrape type 1
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 373d6282-31c7-562e-b795-e7d228f92fa1 sending to next pipeline
2026-03-28 08:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 373d6282-31c7-562e-b795-e7d228f92fa1, identifier: CG81228
2026-03-28 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-28 08:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-28 08:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228 to the API
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2700c1c34531377bfd7879388e8dd44e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:23:59Z',
 'fuel_type': 'diesel',
 'id': '373d6282-31c7-562e-b795-e7d228f92fa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG81228',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 257054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2700c1c34531377bfd7879388e8dd44e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_2fa1a87ec35a2c1ff5af383173c94339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_9c4c3c555ba18f81c7e1c95196c2109c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_a252a11c9de010b79b1cf4fd1a478dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_d1b35997164278bfdeddb633e691162b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_373d6282-31c7-562e-b795-e7d228f92fa1/373d6282-31c7-562e-b795-e7d228f92fa1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b6/8eb63a2c827912a131481b0fda6f1abb/pa/CG81228_7881ab899a132ec88e31759a1c1129e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2011}
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-28 08:35:36 [auto1.be] INFO: Saving data for CG81228: {'created_time': 1774686936.80688, 'last_price_update_time': 1774686936.806892, 'auction_closing_time': 1774884239.0}
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG81228') HTTP/1.1" 204 0
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_9fd5c52378fd1f8bd6b45ca995a64471.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_5bf73e7bde4d2f816c38313497f04cee.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64daf90>
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7a%252Fc67aab24b9caeade28114fb239702e0d%252Fpa%252FHY97997_b9a220ac8def29418432e4e11845c9d3.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_b9a220ac8def29418432e4e11845c9d3.jpg saved to cache
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e07c09c-348e-5621-9b4c-da3fc758ab99
2026-03-28 08:35:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e07c09c-348e-5621-9b4c-da3fc758ab99, skipping ID generation
2026-03-28 08:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 with scrape type 1
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 sending to next pipeline
2026-03-28 08:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e07c09c-348e-5621-9b4c-da3fc758ab99, identifier: HY97997
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d941d0>
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_67b729fb6f16580ce0c0c24875c79628.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_67b729fb6f16580ce0c0c24875c79628.jpg saved to cache
2026-03-28 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:37 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6fbc9d0>
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_fa400a1a33600e09bc89b8f01b8e061c.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_fa400a1a33600e09bc89b8f01b8e061c.jpg saved to cache
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d2c290>
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_78171ba08b54d889b355ca99c2afe425.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_78171ba08b54d889b355ca99c2afe425.jpg saved to cache
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d2d350>
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_f8f6d5d0214063c6f055489227d6fdaf.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_f8f6d5d0214063c6f055489227d6fdaf.jpg saved to cache
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64480d0>
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_7b13375d3c2d0ee899c592b16241129c.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7b13375d3c2d0ee899c592b16241129c.jpg saved to cache
2026-03-28 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-28 08:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-28 08:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997 to the API
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_b9a220ac8def29418432e4e11845c9d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:40:51Z',
 'fuel_type': 'diesel',
 'id': '4e07c09c-348e-5621-9b4c-da3fc758ab99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY97997',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 178955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_b9a220ac8def29418432e4e11845c9d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e26d410d602b319ef57fd8151658f198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5015c880117f7e46a3f220f4c73e8f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_fc1997414d195aa9afc4e27abcd4f493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_e6b6747d09f7d4f7bebf8b558f25acca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6ac4211e21d2f96cdeedd96ad1d18b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_15b3e2dcc45348cf49d2dd4895ead0c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_5ae6edf4325e77f8e8bf315d03232b4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_6caf4f0d200fe7d9ddefb96a8fc5b5e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e07c09c-348e-5621-9b4c-da3fc758ab99/4e07c09c-348e-5621-9b4c-da3fc758ab99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7a/c67aab24b9caeade28114fb239702e0d/pa/HY97997_aedace3e12e1068fa6735cae9df2a763.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Saving data for HY97997: {'created_time': 1774686938.06072, 'last_price_update_time': 1774686938.060729, 'auction_closing_time': 1774885251.0}
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY97997') HTTP/1.1" 204 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for RB14392: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for MY55708: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for XK15851: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA93870%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for TA93870: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF06459%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for JF06459: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ99747%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for PZ99747: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB53896%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for TB53896: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL30549%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for PL30549: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS47676%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for KS47676: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU28222%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for KU28222: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN33262%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for LN33262: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC85996%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for XC85996: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 08:35:38 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-28 08:35:38 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-28 08:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_b84e76b8a9c176bb019ee312a792e190.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc119150>
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_9fd5c52378fd1f8bd6b45ca995a64471.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_9fd5c52378fd1f8bd6b45ca995a64471.jpg saved to cache
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f30890>
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_5bf73e7bde4d2f816c38313497f04cee.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_5bf73e7bde4d2f816c38313497f04cee.jpg saved to cache
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc079e10>
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F63%252Fd06362b6e9bc632172e09e637d4fd924%252Fpa%252FPC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg saved to cache
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5fb589-9951-5f71-991b-a5e438cec510
2026-03-28 08:35:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5fb589-9951-5f71-991b-a5e438cec510, skipping ID generation
2026-03-28 08:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5fb589-9951-5f71-991b-a5e438cec510 with scrape type 1
2026-03-28 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5fb589-9951-5f71-991b-a5e438cec510 sending to next pipeline
2026-03-28 08:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f5fb589-9951-5f71-991b-a5e438cec510, identifier: PC01829
2026-03-28 08:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB63081> (referer: https://www.auto1.com/v1/car-details-view/BB63081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR73229> (referer: https://www.auto1.com/v1/car-details-view/BR73229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ26828> (referer: https://www.auto1.com/v1/car-details-view/VZ26828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-28 08:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-28 08:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829 to the API
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:50:11Z',
 'fuel_type': 'diesel',
 'id': '0f5fb589-9951-5f71-991b-a5e438cec510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC01829',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Seat',
 'model': 'Cordoba',
 'odometer': 133342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7b13375d3c2d0ee899c592b16241129c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_7260e903dc10d0d611863336f3c7fb9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_5bf73e7bde4d2f816c38313497f04cee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_22d9e9eb51cf2babc53270bbc594ee54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_f65c1bc9867cbc1373c0b033ce275d0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5fb589-9951-5f71-991b-a5e438cec510/0f5fb589-9951-5f71-991b-a5e438cec510_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/63/d06362b6e9bc632172e09e637d4fd924/pa/PC01829_c3b9e15c1d2d7366ae995f397126d7f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Cordoba 1.4 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2008}
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [auto1.be] INFO: Saving data for PC01829: {'created_time': 1774686939.100127, 'last_price_update_time': 1774686939.100136, 'auction_closing_time': 1774885811.0}
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC01829') HTTP/1.1" 204 0
2026-03-28 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_fd4babe270ac10c6404dc555a1375121.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2bafe2834aa34ed98e428e2603862ac1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_3891050b2f54ac7f0a351f26f3d0615e.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f36cd0>
2026-03-28 08:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_b84e76b8a9c176bb019ee312a792e190.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_b84e76b8a9c176bb019ee312a792e190.jpg saved to cache
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-28 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee474fd8-a289-5202-9ddb-cc5aac801ba1 with scrape type 1
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee474fd8-a289-5202-9ddb-cc5aac801ba1
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_61e49b63d5f7661fb310fae3217cbe70.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_61e49b63d5f7661fb310fae3217cbe70.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_18b2c040e5d34dae3d7e2167be719fb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_18b2c040e5d34dae3d7e2167be719fb9.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_127932806e709a0b857d95e0a496cb9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_127932806e709a0b857d95e0a496cb9d.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_bca9141cb56e64f77857cd72fba8db92.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_bca9141cb56e64f77857cd72fba8db92.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_bbcd6319859c5fabf81c6fffe5a10e3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_bbcd6319859c5fabf81c6fffe5a10e3c.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_6ac79ddc20a09fa06384282f31a3fd17.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_6ac79ddc20a09fa06384282f31a3fd17.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_ee3527ba7a387968ab5deb58d470ce08.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_ee3527ba7a387968ab5deb58d470ce08.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_3f30af876739f09352f90f141681344f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_3f30af876739f09352f90f141681344f.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_ec5dfe87e4d91730500873abfc2e61e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_ec5dfe87e4d91730500873abfc2e61e3.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F37%252Fa137cc421f9d2864de2afd366a67d721%252Fpa%252FBB63081_aa81a6ac3257e34a1571f15601e7df75.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_aa81a6ac3257e34a1571f15601e7df75.jpg already downloaded
2026-03-28 08:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee474fd8-a289-5202-9ddb-cc5aac801ba1, identifier: BB63081
2026-03-28 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-28 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb3668b-8a1a-528d-abd1-d0317422561b with scrape type 1
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbb3668b-8a1a-528d-abd1-d0317422561b
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_8b520799a1b23d2c265655102bd4ea83.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_8b520799a1b23d2c265655102bd4ea83.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_6e15808eb43532d0c52601834746672c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_6e15808eb43532d0c52601834746672c.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_d5e4b367e5ee650ddf600a091c8b55e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_d5e4b367e5ee650ddf600a091c8b55e9.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_700314cbf2445913445e7b9b737637e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_700314cbf2445913445e7b9b737637e1.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_9e0bb0f7ba71fca48f04cdeb484f55b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_9e0bb0f7ba71fca48f04cdeb484f55b4.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_d08d49dcb06cfbb066240f50e9f91f27.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_d08d49dcb06cfbb066240f50e9f91f27.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_b2247d1730216cbc07f28eaef196d641.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_b2247d1730216cbc07f28eaef196d641.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_8a773a918df9b4a20f77a7d6cd0451de.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_8a773a918df9b4a20f77a7d6cd0451de.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_767504d0b0ca8d444a750952dbe85e87.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_767504d0b0ca8d444a750952dbe85e87.jpg already downloaded
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3c%252Fae3c629a7587b5924a32c67e7277f8b8%252Fpa%252FBR73229_4f15397a213e1e4fda98c8f1122f5c13.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_4f15397a213e1e4fda98c8f1122f5c13.jpg already downloaded
2026-03-28 08:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbb3668b-8a1a-528d-abd1-d0317422561b, identifier: BR73229
2026-03-28 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-28 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7854656e-d739-5aba-aa3a-86968c28e4be with scrape type 1
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a802705e49a84ee479040c24aa3b2e2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a802705e49a84ee479040c24aa3b2e2b.jpg not downloaded yet
2026-03-28 08:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-28 08:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-28 08:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081 to the API
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB63081>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:58:00Z',
 'fuel_type': 'diesel',
 'id': 'ee474fd8-a289-5202-9ddb-cc5aac801ba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB63081',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 85505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_61e49b63d5f7661fb310fae3217cbe70.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_18b2c040e5d34dae3d7e2167be719fb9.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_127932806e709a0b857d95e0a496cb9d.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_bca9141cb56e64f77857cd72fba8db92.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_bbcd6319859c5fabf81c6fffe5a10e3c.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_6ac79ddc20a09fa06384282f31a3fd17.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_ee3527ba7a387968ab5deb58d470ce08.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_3f30af876739f09352f90f141681344f.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_ec5dfe87e4d91730500873abfc2e61e3.jpg',
                'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_aa81a6ac3257e34a1571f15601e7df75.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_61e49b63d5f7661fb310fae3217cbe70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_18b2c040e5d34dae3d7e2167be719fb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_127932806e709a0b857d95e0a496cb9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_bca9141cb56e64f77857cd72fba8db92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_bbcd6319859c5fabf81c6fffe5a10e3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_6ac79ddc20a09fa06384282f31a3fd17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_ee3527ba7a387968ab5deb58d470ce08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_3f30af876739f09352f90f141681344f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_ec5dfe87e4d91730500873abfc2e61e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee474fd8-a289-5202-9ddb-cc5aac801ba1/ee474fd8-a289-5202-9ddb-cc5aac801ba1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/37/a137cc421f9d2864de2afd366a67d721/pa/BB63081_aa81a6ac3257e34a1571f15601e7df75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-28 08:35:40 [auto1.be] INFO: Saving data for BB63081: {'created_time': 1774686940.089522, 'last_price_update_time': 1774686940.089531, 'auction_closing_time': 1774886280.0}
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB63081') HTTP/1.1" 204 0
2026-03-28 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-28 08:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-28 08:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229 to the API
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BR73229>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:16Z',
 'fuel_type': 'diesel',
 'id': 'cbb3668b-8a1a-528d-abd1-d0317422561b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR73229',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 123260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_8b520799a1b23d2c265655102bd4ea83.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_6e15808eb43532d0c52601834746672c.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_d5e4b367e5ee650ddf600a091c8b55e9.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_700314cbf2445913445e7b9b737637e1.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_9e0bb0f7ba71fca48f04cdeb484f55b4.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_d08d49dcb06cfbb066240f50e9f91f27.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_b2247d1730216cbc07f28eaef196d641.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_8a773a918df9b4a20f77a7d6cd0451de.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_767504d0b0ca8d444a750952dbe85e87.jpg',
                'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_4f15397a213e1e4fda98c8f1122f5c13.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_8b520799a1b23d2c265655102bd4ea83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_6e15808eb43532d0c52601834746672c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_d5e4b367e5ee650ddf600a091c8b55e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_700314cbf2445913445e7b9b737637e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_9e0bb0f7ba71fca48f04cdeb484f55b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_d08d49dcb06cfbb066240f50e9f91f27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_b2247d1730216cbc07f28eaef196d641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_8a773a918df9b4a20f77a7d6cd0451de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_767504d0b0ca8d444a750952dbe85e87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb3668b-8a1a-528d-abd1-d0317422561b/cbb3668b-8a1a-528d-abd1-d0317422561b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3c/ae3c629a7587b5924a32c67e7277f8b8/pa/BR73229_4f15397a213e1e4fda98c8f1122f5c13.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-28 08:35:40 [auto1.be] INFO: Saving data for BR73229: {'created_time': 1774686940.420679, 'last_price_update_time': 1774686940.42069, 'auction_closing_time': 1774883956.0}
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR73229') HTTP/1.1" 204 0
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_29c2b8349cd1b5d21897a9adeab77041.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_29c2b8349cd1b5d21897a9adeab77041.jpg not downloaded yet
2026-03-28 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_bb6eaa049791e23cfcf9a514f1e64e9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_c062991004dd7509c8285f7ab41e1164.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_c062991004dd7509c8285f7ab41e1164.jpg not downloaded yet
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f41190>
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_fd4babe270ac10c6404dc555a1375121.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_fd4babe270ac10c6404dc555a1375121.jpg saved to cache
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f35f90>
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_2bafe2834aa34ed98e428e2603862ac1.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2bafe2834aa34ed98e428e2603862ac1.jpg saved to cache
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d3ce50>
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_3891050b2f54ac7f0a351f26f3d0615e.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_3891050b2f54ac7f0a351f26f3d0615e.jpg saved to cache
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0ea410>
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F99%252F6699235f23b2786bbe8ac79105c2bd63%252Fpa%252FCE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg saved to cache
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31345bdc-1875-5eb2-93ff-11d119f18053
2026-03-28 08:35:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31345bdc-1875-5eb2-93ff-11d119f18053, skipping ID generation
2026-03-28 08:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31345bdc-1875-5eb2-93ff-11d119f18053 with scrape type 1
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31345bdc-1875-5eb2-93ff-11d119f18053 sending to next pipeline
2026-03-28 08:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31345bdc-1875-5eb2-93ff-11d119f18053, identifier: CE27208
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_0284da84bc28a15cf13086a46ac33af1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0284da84bc28a15cf13086a46ac33af1.jpg not downloaded yet
2026-03-28 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-28 08:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208 to the API
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'petrol',
 'id': '31345bdc-1875-5eb2-93ff-11d119f18053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE27208',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 8364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707464,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_2417423dc70b9de766f92ac19ca8690b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_ae09f5cf81e92808ca48b6a4884cfba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_e1db4e4996c899bfbb6cc9508b10595d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_212a60ce32ca38d77995d2a3d5b63e1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_fa400a1a33600e09bc89b8f01b8e061c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_5aeefe266a9ce4fb26395f1c78b4363d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_b63a7544c4e67af71c518a7264151309.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_f8f6d5d0214063c6f055489227d6fdaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_161531624aefb0eb4b1eec66a1c47857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31345bdc-1875-5eb2-93ff-11d119f18053/31345bdc-1875-5eb2-93ff-11d119f18053_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2513448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/99/6699235f23b2786bbe8ac79105c2bd63/pa/CE27208_78171ba08b54d889b355ca99c2afe425.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2019}
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-28 08:35:41 [auto1.be] INFO: Saving data for CE27208: {'created_time': 1774686941.360472, 'last_price_update_time': 1774686941.360482, 'auction_closing_time': 1774883761.0}
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE27208') HTTP/1.1" 204 0
2026-03-28 08:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a802705e49a84ee479040c24aa3b2e2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a1bcf0e5118c936c7f9313e2c3b6825e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a1bcf0e5118c936c7f9313e2c3b6825e.jpg not downloaded yet
2026-03-28 08:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT87936> (referer: https://www.auto1.com/v1/car-details-view/ZT87936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b642f550>
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_bb6eaa049791e23cfcf9a514f1e64e9e.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_bb6eaa049791e23cfcf9a514f1e64e9e.jpg saved to cache
2026-03-28 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f31a10>
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce3703ba2f852718f0e7105e6e06461%252Fpa%252FTF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg saved to cache
2026-03-28 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1
2026-03-28 08:35:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b3b949e-44a0-59d0-a8b1-c64894673dc1, skipping ID generation
2026-03-28 08:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with scrape type 1
2026-03-28 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 sending to next pipeline
2026-03-28 08:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b3b949e-44a0-59d0-a8b1-c64894673dc1, identifier: TF70513
2026-03-28 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-28 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-28 08:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513 to the API
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:48Z',
 'fuel_type': 'diesel',
 'id': '9b3b949e-44a0-59d0-a8b1-c64894673dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF70513',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 281912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_bb6eaa049791e23cfcf9a514f1e64e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_735f8a16b0c50cc6c06745fbf2fc5715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_3891050b2f54ac7f0a351f26f3d0615e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2bafe2834aa34ed98e428e2603862ac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_fd4babe270ac10c6404dc555a1375121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_b84e76b8a9c176bb019ee312a792e190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2821824,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_2162107da365f0107f620c396d4a8078.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_cf55c6af40f7f6922e462f32ecdab707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2796613,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_ba753f2ff75818d2d716cda992422bc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b3b949e-44a0-59d0-a8b1-c64894673dc1/9b3b949e-44a0-59d0-a8b1-c64894673dc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce3703ba2f852718f0e7105e6e06461/pa/TF70513_7cfca4bc09c14d8c986bca3cfdf81ded.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-28 08:35:41 [auto1.be] INFO: Saving data for TF70513: {'created_time': 1774686941.957169, 'last_price_update_time': 1774686941.957178, 'auction_closing_time': 1774883328.0}
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF70513') HTTP/1.1" 204 0
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_0ced447d28a7c57b0bf29373c36262b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0ced447d28a7c57b0bf29373c36262b6.jpg not downloaded yet
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_29c2b8349cd1b5d21897a9adeab77041.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_c062991004dd7509c8285f7ab41e1164.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64942d0>
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a802705e49a84ee479040c24aa3b2e2b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a802705e49a84ee479040c24aa3b2e2b.jpg saved to cache
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-28 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595b3383-415b-59b6-b010-7045f09ab499 with scrape type 1
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_0111df8ed7cf0fa1fce9f965fbba671c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0111df8ed7cf0fa1fce9f965fbba671c.jpg not downloaded yet
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a9ec1a1716111d3f1207eb4113421066.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a9ec1a1716111d3f1207eb4113421066.jpg not downloaded yet
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_f57f7987dc821c5f8393abdc670f0291.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_f57f7987dc821c5f8393abdc670f0291.jpg not downloaded yet
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0284da84bc28a15cf13086a46ac33af1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_8a31a58875cd087c636b8a11c23d74d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_8a31a58875cd087c636b8a11c23d74d6.jpg not downloaded yet
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_2257088df6f991397d62b973f6439b21.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_2257088df6f991397d62b973f6439b21.jpg not downloaded yet
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a10ec2cb9acb9447064f9851da72843b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a10ec2cb9acb9447064f9851da72843b.jpg not downloaded yet
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_b4058143a8d88e2e73e66daa40382429.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_b4058143a8d88e2e73e66daa40382429.jpg not downloaded yet
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bd15a4d0>
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_29c2b8349cd1b5d21897a9adeab77041.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_29c2b8349cd1b5d21897a9adeab77041.jpg saved to cache
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc07ab10>
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_c062991004dd7509c8285f7ab41e1164.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_c062991004dd7509c8285f7ab41e1164.jpg saved to cache
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_95b8dad962b074027d105c5e75940082.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_95b8dad962b074027d105c5e75940082.jpg not downloaded yet
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0ced447d28a7c57b0bf29373c36262b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_d273d10d8ea937176d238a29f12309f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_d273d10d8ea937176d238a29f12309f5.jpg not downloaded yet
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0111df8ed7cf0fa1fce9f965fbba671c.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a1bcf0e5118c936c7f9313e2c3b6825e.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_955057c4989a2ef4da655b19fea169ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_955057c4989a2ef4da655b19fea169ba.jpg not downloaded yet
2026-03-28 08:35:42 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6eee990>
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_0284da84bc28a15cf13086a46ac33af1.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0284da84bc28a15cf13086a46ac33af1.jpg saved to cache
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_0895dc2539106476c6fc0d20c1c0ef18.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0895dc2539106476c6fc0d20c1c0ef18.jpg not downloaded yet
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a9ec1a1716111d3f1207eb4113421066.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ92638%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for EZ92638: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-28 08:35:42 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68139%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [auto1.be] INFO: Scrape type for GM68139: 2
2026-03-28 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 119afc6b-6afc-58e5-8170-c57e5f15f18c with identifier: GM68139
2026-03-28 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 119afc6b-6afc-58e5-8170-c57e5f15f18c with scrape type 2
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 119afc6b-6afc-58e5-8170-c57e5f15f18c with scrape type 2
2026-03-28 08:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 119afc6b-6afc-58e5-8170-c57e5f15f18c, identifier: GM68139
2026-03-28 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_f57f7987dc821c5f8393abdc670f0291.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_17817795e11bfb4dff9546aaac47cf4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_17817795e11bfb4dff9546aaac47cf4b.jpg not downloaded yet
2026-03-28 08:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 119afc6b-6afc-58e5-8170-c57e5f15f18c with identifier: GM68139
2026-03-28 08:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 119afc6b-6afc-58e5-8170-c57e5f15f18c with identifier: GM68139
2026-03-28 08:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 119afc6b-6afc-58e5-8170-c57e5f15f18c with identifier: GM68139 to the API
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:15Z',
 'fuel_type': 'diesel',
 'id': '119afc6b-6afc-58e5-8170-c57e5f15f18c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM68139',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 84504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 140 Stop&Start',
 'transmission': 'manual',
 'trim': '335 L2H2 140 Stop&Start',
 'year': 2023}
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68139%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Saving data for GM68139: {'auction_closing_time': 1774716075.0, 'created_time': 1774471321.930755, 'last_price_update_time': 1774686943.086726}
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM68139') HTTP/1.1" 204 0
2026-03-28 08:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Scrape type for VC92856: 2
2026-03-28 08:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-28 08:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170033d5-e694-5b56-85da-656784e780ca with scrape type 2
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 170033d5-e694-5b56-85da-656784e780ca with scrape type 2
2026-03-28 08:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 170033d5-e694-5b56-85da-656784e780ca, identifier: VC92856
2026-03-28 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_eecd35067b7b4274ef0e56a7a9a772e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_8a31a58875cd087c636b8a11c23d74d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_2257088df6f991397d62b973f6439b21.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_145ed045bc0cbf9b0fc7048d41976589.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_145ed045bc0cbf9b0fc7048d41976589.jpg not downloaded yet
2026-03-28 08:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-28 08:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-28 08:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856 to the API
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 401,
 'expiration_date': '2026-03-28T16:01:06Z',
 'fuel_type': 'petrol',
 'id': '170033d5-e694-5b56-85da-656784e780ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC92856',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Ram 1500',
 'odometer': 132361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-16',
 'seller_name': None,
 'title': 'Dodge Ram 1500 5.7 V8 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2019}
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Saving data for VC92856: {'auction_closing_time': 1774713666.0, 'created_time': 1774471416.187323, 'last_price_update_time': 1774686943.676052}
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VC92856') HTTP/1.1" 204 0
2026-03-28 08:35:43 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56450%27 HTTP/1.1" 200 None
2026-03-28 08:35:43 [auto1.be] INFO: Scrape type for CW56450: 2
2026-03-28 08:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9031b687-7bde-5ea3-9631-2f1184a6a02c with identifier: CW56450
2026-03-28 08:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9031b687-7bde-5ea3-9631-2f1184a6a02c with scrape type 2
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9031b687-7bde-5ea3-9631-2f1184a6a02c with scrape type 2
2026-03-28 08:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9031b687-7bde-5ea3-9631-2f1184a6a02c, identifier: CW56450
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b642db10>
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_0ced447d28a7c57b0bf29373c36262b6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0ced447d28a7c57b0bf29373c36262b6.jpg saved to cache
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6da6850>
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_0111df8ed7cf0fa1fce9f965fbba671c.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0111df8ed7cf0fa1fce9f965fbba671c.jpg saved to cache
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6e1a910>
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a1bcf0e5118c936c7f9313e2c3b6825e.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a1bcf0e5118c936c7f9313e2c3b6825e.jpg saved to cache
2026-03-28 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bcecf790>
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a9ec1a1716111d3f1207eb4113421066.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a9ec1a1716111d3f1207eb4113421066.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b644cd90>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_f57f7987dc821c5f8393abdc670f0291.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_f57f7987dc821c5f8393abdc670f0291.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a10ec2cb9acb9447064f9851da72843b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_b4058143a8d88e2e73e66daa40382429.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg not downloaded yet
2026-03-28 08:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9031b687-7bde-5ea3-9631-2f1184a6a02c with identifier: CW56450
2026-03-28 08:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9031b687-7bde-5ea3-9631-2f1184a6a02c with identifier: CW56450
2026-03-28 08:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9031b687-7bde-5ea3-9631-2f1184a6a02c with identifier: CW56450 to the API
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:32:05Z',
 'fuel_type': 'diesel',
 'id': '9031b687-7bde-5ea3-9631-2f1184a6a02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW56450',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 103112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-13',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Business XL Komfort Plus Doppelkabine',
 'transmission': 'manual',
 'trim': 'Business XL Komfort Plus Doppelkabine',
 'year': 2019}
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56450%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Saving data for CW56450: {'auction_closing_time': 1774715525.0, 'created_time': 1774384611.832857, 'last_price_update_time': 1774686944.418138}
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW56450') HTTP/1.1" 204 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44926%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for UA44926: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for YS75558: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ37303%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for PJ37303: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 08:35:44 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-28 08:35:44 [auto1.be] INFO: Scrape type for LM02594: 0
2026-03-28 08:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b649f2d0>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_eecd35067b7b4274ef0e56a7a9a772e3.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_eecd35067b7b4274ef0e56a7a9a772e3.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d33250>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_8a31a58875cd087c636b8a11c23d74d6.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_8a31a58875cd087c636b8a11c23d74d6.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d5cfd0>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_2257088df6f991397d62b973f6439b21.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_2257088df6f991397d62b973f6439b21.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_95b8dad962b074027d105c5e75940082.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_d273d10d8ea937176d238a29f12309f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_955057c4989a2ef4da655b19fea169ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bdcd0a50>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_a10ec2cb9acb9447064f9851da72843b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a10ec2cb9acb9447064f9851da72843b.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6dc2010>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_b4058143a8d88e2e73e66daa40382429.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_b4058143a8d88e2e73e66daa40382429.jpg saved to cache
2026-03-28 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_4061cc41572491ff694e0e91f34128c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8d9d18413f407c721bf21c49c1aafafa.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_5da16a88294499b9995d305c0b7cc363.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64befd0>
2026-03-28 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F78%252F62782092b8ad269c40f12da8525dc878%252Fpa%252FVZ26828_95b8dad962b074027d105c5e75940082.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_95b8dad962b074027d105c5e75940082.jpg saved to cache
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7854656e-d739-5aba-aa3a-86968c28e4be
2026-03-28 08:35:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7854656e-d739-5aba-aa3a-86968c28e4be, skipping ID generation
2026-03-28 08:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7854656e-d739-5aba-aa3a-86968c28e4be with scrape type 1
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7854656e-d739-5aba-aa3a-86968c28e4be sending to next pipeline
2026-03-28 08:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7854656e-d739-5aba-aa3a-86968c28e4be, identifier: VZ26828
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d5e410>
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_d273d10d8ea937176d238a29f12309f5.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_d273d10d8ea937176d238a29f12309f5.jpg saved to cache
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-28 08:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-28 08:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828 to the API
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_95b8dad962b074027d105c5e75940082.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:21:48Z',
 'fuel_type': 'diesel',
 'id': '7854656e-d739-5aba-aa3a-86968c28e4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ26828',
 'listing': 'auction',
 'location': 'BE, Herk-de-Stad',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 250776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a802705e49a84ee479040c24aa3b2e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_29c2b8349cd1b5d21897a9adeab77041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_c062991004dd7509c8285f7ab41e1164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0284da84bc28a15cf13086a46ac33af1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a1bcf0e5118c936c7f9313e2c3b6825e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_0ced447d28a7c57b0bf29373c36262b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a9ec1a1716111d3f1207eb4113421066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_8a31a58875cd087c636b8a11c23d74d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_a10ec2cb9acb9447064f9851da72843b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7854656e-d739-5aba-aa3a-86968c28e4be/7854656e-d739-5aba-aa3a-86968c28e4be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/78/62782092b8ad269c40f12da8525dc878/pa/VZ26828_95b8dad962b074027d105c5e75940082.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
 'transmission': 'automatic',
 'trim': 'Kasten',
 'year': 2017}
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-28 08:35:45 [auto1.be] INFO: Saving data for VZ26828: {'created_time': 1774686945.543288, 'last_price_update_time': 1774686945.543298, 'auction_closing_time': 1774884108.0}
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ26828') HTTP/1.1" 204 0
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6483450>
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_955057c4989a2ef4da655b19fea169ba.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_955057c4989a2ef4da655b19fea169ba.jpg saved to cache
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_145ed045bc0cbf9b0fc7048d41976589.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_17817795e11bfb4dff9546aaac47cf4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0895dc2539106476c6fc0d20c1c0ef18.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d225d0>
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_4061cc41572491ff694e0e91f34128c9.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_4061cc41572491ff694e0e91f34128c9.jpg saved to cache
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc0c4850>
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_8d9d18413f407c721bf21c49c1aafafa.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8d9d18413f407c721bf21c49c1aafafa.jpg saved to cache
2026-03-28 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc123a90>
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F5f%252Fc75f1e217ea92d1faa262fb22ca59d26%252Fpa%252FZD95004_5da16a88294499b9995d305c0b7cc363.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_5da16a88294499b9995d305c0b7cc363.jpg saved to cache
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289
2026-03-28 08:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289, skipping ID generation
2026-03-28 08:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with scrape type 1
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 sending to next pipeline
2026-03-28 08:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289, identifier: ZD95004
2026-03-28 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-28 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-28 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004 to the API
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_5da16a88294499b9995d305c0b7cc363.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'diesel',
 'id': '3d2d86d1-d7da-5fd4-b70f-8cdc28dca289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD95004',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 109596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3358895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_5da16a88294499b9995d305c0b7cc363.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3498704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_4061cc41572491ff694e0e91f34128c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8f8fe5f884c12abafbdd1485bb61c57e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2947235,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_eecd35067b7b4274ef0e56a7a9a772e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3312991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_8d9d18413f407c721bf21c49c1aafafa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_9fd5c52378fd1f8bd6b45ca995a64471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_67b729fb6f16580ce0c0c24875c79628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_1188ff8a1807bda088f0a6383e1ac537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3368082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_c8a18d907eba05c6c117d0376ee14802.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2d86d1-d7da-5fd4-b70f-8cdc28dca289/3d2d86d1-d7da-5fd4-b70f-8cdc28dca289_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/5f/c75f1e217ea92d1faa262fb22ca59d26/pa/ZD95004_a74b81170bed19a027ad49514e2a965f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-28 08:35:46 [auto1.be] INFO: Saving data for ZD95004: {'created_time': 1774686946.518636, 'last_price_update_time': 1774686946.518646, 'auction_closing_time': 1774884844.0}
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD95004') HTTP/1.1" 204 0
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bce8a550>
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_145ed045bc0cbf9b0fc7048d41976589.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_145ed045bc0cbf9b0fc7048d41976589.jpg saved to cache
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6e2d650>
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_17817795e11bfb4dff9546aaac47cf4b.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_17817795e11bfb4dff9546aaac47cf4b.jpg saved to cache
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6e40e10>
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_0895dc2539106476c6fc0d20c1c0ef18.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0895dc2539106476c6fc0d20c1c0ef18.jpg saved to cache
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f8db90>
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fa2%252Fefa24059efd9f90391cf1b654650b577%252Fpa%252FZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg saved to cache
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 595b3383-415b-59b6-b010-7045f09ab499
2026-03-28 08:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 595b3383-415b-59b6-b010-7045f09ab499, skipping ID generation
2026-03-28 08:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595b3383-415b-59b6-b010-7045f09ab499 with scrape type 1
2026-03-28 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 595b3383-415b-59b6-b010-7045f09ab499 sending to next pipeline
2026-03-28 08:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 595b3383-415b-59b6-b010-7045f09ab499, identifier: ZT87936
2026-03-28 08:35:46 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-28 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-28 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936 to the API
2026-03-28 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:15Z',
 'fuel_type': 'petrol',
 'id': '595b3383-415b-59b6-b010-7045f09ab499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT87936',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 210001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0111df8ed7cf0fa1fce9f965fbba671c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_f57f7987dc821c5f8393abdc670f0291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_2257088df6f991397d62b973f6439b21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_b4058143a8d88e2e73e66daa40382429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_d273d10d8ea937176d238a29f12309f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_955057c4989a2ef4da655b19fea169ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_0895dc2539106476c6fc0d20c1c0ef18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_17817795e11bfb4dff9546aaac47cf4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_145ed045bc0cbf9b0fc7048d41976589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595b3383-415b-59b6-b010-7045f09ab499/595b3383-415b-59b6-b010-7045f09ab499_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/a2/efa24059efd9f90391cf1b654650b577/pa/ZT87936_a36870d1d6b8bcd9a50b3595a3821464.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Saving data for ZT87936: {'created_time': 1774686947.18161, 'last_price_update_time': 1774686947.18162, 'auction_closing_time': 1774883895.0}
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT87936') HTTP/1.1" 204 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL48181%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for ZL48181: 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS64524%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for WS64524: 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for MH10936: 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for PB88221: 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY53321%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for ZY53321: 2
2026-03-28 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 332455df-4300-5281-8ac4-9b04909870e8 with identifier: ZY53321
2026-03-28 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332455df-4300-5281-8ac4-9b04909870e8 with scrape type 2
2026-03-28 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 332455df-4300-5281-8ac4-9b04909870e8 with scrape type 2
2026-03-28 08:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 332455df-4300-5281-8ac4-9b04909870e8, identifier: ZY53321
2026-03-28 08:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 332455df-4300-5281-8ac4-9b04909870e8 with identifier: ZY53321
2026-03-28 08:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 332455df-4300-5281-8ac4-9b04909870e8 with identifier: ZY53321
2026-03-28 08:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 332455df-4300-5281-8ac4-9b04909870e8 with identifier: ZY53321 to the API
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:54:19Z',
 'fuel_type': 'petrol',
 'id': '332455df-4300-5281-8ac4-9b04909870e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY53321',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 135803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY53321%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Saving data for ZY53321: {'auction_closing_time': 1774716859.0, 'created_time': 1774471054.060413, 'last_price_update_time': 1774686947.853223}
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY53321') HTTP/1.1" 204 0
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 08:35:47 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN14983%27 HTTP/1.1" 200 None
2026-03-28 08:35:47 [auto1.be] INFO: Scrape type for AN14983: 2
2026-03-28 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e39e31d-0fed-5d53-a7b0-d5430c9122e0 with identifier: AN14983
2026-03-28 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e39e31d-0fed-5d53-a7b0-d5430c9122e0 with scrape type 2
2026-03-28 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e39e31d-0fed-5d53-a7b0-d5430c9122e0 with scrape type 2
2026-03-28 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e39e31d-0fed-5d53-a7b0-d5430c9122e0, identifier: AN14983
2026-03-28 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e39e31d-0fed-5d53-a7b0-d5430c9122e0 with identifier: AN14983
2026-03-28 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e39e31d-0fed-5d53-a7b0-d5430c9122e0 with identifier: AN14983
2026-03-28 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e39e31d-0fed-5d53-a7b0-d5430c9122e0 with identifier: AN14983 to the API
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:50:21Z',
 'fuel_type': 'diesel',
 'id': '5e39e31d-0fed-5d53-a7b0-d5430c9122e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN14983',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 101882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2021}
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN14983%27 HTTP/1.1" 200 None
2026-03-28 08:35:48 [auto1.be] INFO: Saving data for AN14983: {'auction_closing_time': 1774716621.0, 'created_time': 1774471148.632994, 'last_price_update_time': 1774686948.400627}
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AN14983') HTTP/1.1" 204 0
2026-03-28 08:35:48 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY60433%27 HTTP/1.1" 200 None
2026-03-28 08:35:48 [auto1.be] INFO: Scrape type for KY60433: 2
2026-03-28 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbaeed1f-5c78-5fe8-8ca4-a4712f05bade with identifier: KY60433
2026-03-28 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbaeed1f-5c78-5fe8-8ca4-a4712f05bade with scrape type 2
2026-03-28 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbaeed1f-5c78-5fe8-8ca4-a4712f05bade with scrape type 2
2026-03-28 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fbaeed1f-5c78-5fe8-8ca4-a4712f05bade, identifier: KY60433
2026-03-28 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fbaeed1f-5c78-5fe8-8ca4-a4712f05bade with identifier: KY60433
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fbaeed1f-5c78-5fe8-8ca4-a4712f05bade with identifier: KY60433
2026-03-28 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fbaeed1f-5c78-5fe8-8ca4-a4712f05bade with identifier: KY60433 to the API
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:03:02Z',
 'fuel_type': 'hybrid',
 'id': 'fbaeed1f-5c78-5fe8-8ca4-a4712f05bade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY60433',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 186569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY60433%27 HTTP/1.1" 200 None
2026-03-28 08:35:48 [auto1.be] INFO: Saving data for KY60433: {'auction_closing_time': 1774713782.0, 'created_time': 1774471301.374668, 'last_price_update_time': 1774686948.975577}
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KY60433') HTTP/1.1" 204 0
2026-03-28 08:35:48 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-28 08:35:49 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV88346%27 HTTP/1.1" 200 None
2026-03-28 08:35:49 [auto1.be] INFO: Scrape type for YV88346: 2
2026-03-28 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 573f0e67-7300-59ec-985c-988df8438c75 with identifier: YV88346
2026-03-28 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573f0e67-7300-59ec-985c-988df8438c75 with scrape type 2
2026-03-28 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 573f0e67-7300-59ec-985c-988df8438c75 with scrape type 2
2026-03-28 08:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 573f0e67-7300-59ec-985c-988df8438c75, identifier: YV88346
2026-03-28 08:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 573f0e67-7300-59ec-985c-988df8438c75 with identifier: YV88346
2026-03-28 08:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 573f0e67-7300-59ec-985c-988df8438c75 with identifier: YV88346
2026-03-28 08:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 573f0e67-7300-59ec-985c-988df8438c75 with identifier: YV88346 to the API
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:43:17Z',
 'fuel_type': 'diesel',
 'id': '573f0e67-7300-59ec-985c-988df8438c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV88346',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 203000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV88346%27 HTTP/1.1" 200 None
2026-03-28 08:35:49 [auto1.be] INFO: Saving data for YV88346: {'auction_closing_time': 1774716197.0, 'created_time': 1774471407.213376, 'last_price_update_time': 1774686949.807202}
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV88346') HTTP/1.1" 204 0
2026-03-28 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS84713> (referer: https://www.auto1.com/v1/car-details-view/TS84713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX76756%27 HTTP/1.1" 200 None
2026-03-28 08:35:49 [auto1.be] INFO: Scrape type for SX76756: 0
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 08:35:49 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN79459%27 HTTP/1.1" 200 None
2026-03-28 08:35:49 [auto1.be] INFO: Scrape type for UN79459: 2
2026-03-28 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caeb318e-d159-55c5-ae64-c253f6151623 with identifier: UN79459
2026-03-28 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caeb318e-d159-55c5-ae64-c253f6151623 with scrape type 2
2026-03-28 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caeb318e-d159-55c5-ae64-c253f6151623 with scrape type 2
2026-03-28 08:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: caeb318e-d159-55c5-ae64-c253f6151623, identifier: UN79459
2026-03-28 08:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: caeb318e-d159-55c5-ae64-c253f6151623 with identifier: UN79459
2026-03-28 08:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: caeb318e-d159-55c5-ae64-c253f6151623 with identifier: UN79459
2026-03-28 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: caeb318e-d159-55c5-ae64-c253f6151623 with identifier: UN79459 to the API
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:29Z',
 'fuel_type': 'diesel',
 'id': 'caeb318e-d159-55c5-ae64-c253f6151623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN79459',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 244432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2015}
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN79459%27 HTTP/1.1" 200 None
2026-03-28 08:35:50 [auto1.be] INFO: Saving data for UN79459: {'auction_closing_time': 1774716029.0, 'created_time': 1774471424.623113, 'last_price_update_time': 1774686950.262011}
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UN79459') HTTP/1.1" 204 0
2026-03-28 08:35:50 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD83049%27 HTTP/1.1" 200 None
2026-03-28 08:35:50 [auto1.be] INFO: Scrape type for RD83049: 0
2026-03-28 08:35:50 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64261%27 HTTP/1.1" 200 None
2026-03-28 08:35:50 [auto1.be] INFO: Scrape type for UE64261: 2
2026-03-28 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b44a46eb-8d5e-51fc-a134-73ed5ba984ef with identifier: UE64261
2026-03-28 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b44a46eb-8d5e-51fc-a134-73ed5ba984ef with scrape type 2
2026-03-28 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b44a46eb-8d5e-51fc-a134-73ed5ba984ef with scrape type 2
2026-03-28 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b44a46eb-8d5e-51fc-a134-73ed5ba984ef, identifier: UE64261
2026-03-28 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b44a46eb-8d5e-51fc-a134-73ed5ba984ef with identifier: UE64261
2026-03-28 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b44a46eb-8d5e-51fc-a134-73ed5ba984ef with identifier: UE64261
2026-03-28 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b44a46eb-8d5e-51fc-a134-73ed5ba984ef with identifier: UE64261 to the API
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:13:38Z',
 'fuel_type': 'petrol',
 'id': 'b44a46eb-8d5e-51fc-a134-73ed5ba984ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE64261',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 104305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64261%27 HTTP/1.1" 200 None
2026-03-28 08:35:50 [auto1.be] INFO: Saving data for UE64261: {'auction_closing_time': 1774714418.0, 'created_time': 1774471142.452498, 'last_price_update_time': 1774686950.788382}
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE64261') HTTP/1.1" 204 0
2026-03-28 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-28 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5305e02-626b-571c-9d4c-427af525642d with scrape type 1
2026-03-28 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_9c4b8b4b3036f2b4b10ef9d2d3396b14.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_9c4b8b4b3036f2b4b10ef9d2d3396b14.jpg not downloaded yet
2026-03-28 08:35:50 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA02413%27 HTTP/1.1" 200 None
2026-03-28 08:35:50 [auto1.be] INFO: Scrape type for UA02413: 2
2026-03-28 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d27fa7-7ea4-511c-abad-2643c74d78b2 with identifier: UA02413
2026-03-28 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d27fa7-7ea4-511c-abad-2643c74d78b2 with scrape type 2
2026-03-28 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d27fa7-7ea4-511c-abad-2643c74d78b2 with scrape type 2
2026-03-28 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3d27fa7-7ea4-511c-abad-2643c74d78b2, identifier: UA02413
2026-03-28 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3d27fa7-7ea4-511c-abad-2643c74d78b2 with identifier: UA02413
2026-03-28 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3d27fa7-7ea4-511c-abad-2643c74d78b2 with identifier: UA02413
2026-03-28 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3d27fa7-7ea4-511c-abad-2643c74d78b2 with identifier: UA02413 to the API
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:48Z',
 'fuel_type': 'diesel',
 'id': 'c3d27fa7-7ea4-511c-abad-2643c74d78b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA02413',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 200948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2013}
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA02413%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Saving data for UA02413: {'auction_closing_time': 1774715028.0, 'created_time': 1774471334.925997, 'last_price_update_time': 1774686951.250376}
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA02413') HTTP/1.1" 204 0
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_665952e5bd8d90a61a99685aeadc1886.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_665952e5bd8d90a61a99685aeadc1886.jpg not downloaded yet
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Scrape type for PL33803: 0
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR59169%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Scrape type for GR59169: 2
2026-03-28 08:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fc7883-34ea-5ecb-aed0-d3eab52e018a with identifier: GR59169
2026-03-28 08:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fc7883-34ea-5ecb-aed0-d3eab52e018a with scrape type 2
2026-03-28 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3fc7883-34ea-5ecb-aed0-d3eab52e018a with scrape type 2
2026-03-28 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3fc7883-34ea-5ecb-aed0-d3eab52e018a, identifier: GR59169
2026-03-28 08:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3fc7883-34ea-5ecb-aed0-d3eab52e018a with identifier: GR59169
2026-03-28 08:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3fc7883-34ea-5ecb-aed0-d3eab52e018a with identifier: GR59169
2026-03-28 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3fc7883-34ea-5ecb-aed0-d3eab52e018a with identifier: GR59169 to the API
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:22:15Z',
 'fuel_type': 'hybrid',
 'id': 'd3fc7883-34ea-5ecb-aed0-d3eab52e018a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR59169',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 24655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-In-Hybrid N Line 4WD',
 'transmission': 'automatic',
 'trim': 'N Line 4WD',
 'year': 2022}
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR59169%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Saving data for GR59169: {'auction_closing_time': 1774714935.0, 'created_time': 1774471062.055537, 'last_price_update_time': 1774686951.761898}
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR59169') HTTP/1.1" 204 0
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_4006f9694ac16990f17afc96be61940d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_4006f9694ac16990f17afc96be61940d.jpg not downloaded yet
2026-03-28 08:35:51 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [auto1.be] INFO: Scrape type for CD50328: 0
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_1ff87c0a1d9ed20c91c451be8045db7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1ff87c0a1d9ed20c91c451be8045db7d.jpg not downloaded yet
2026-03-28 08:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_9c4b8b4b3036f2b4b10ef9d2d3396b14.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_1741e7acb6787ba9524ce0647a886f2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1741e7acb6787ba9524ce0647a886f2a.jpg not downloaded yet
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_c7bf6acd267834fb548497a8994e2337.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_c7bf6acd267834fb548497a8994e2337.jpg not downloaded yet
2026-03-28 08:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_4006f9694ac16990f17afc96be61940d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_665952e5bd8d90a61a99685aeadc1886.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bd159ad0>
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_9c4b8b4b3036f2b4b10ef9d2d3396b14.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_9c4b8b4b3036f2b4b10ef9d2d3396b14.jpg saved to cache
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1ff87c0a1d9ed20c91c451be8045db7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1741e7acb6787ba9524ce0647a886f2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6d479d0>
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_4006f9694ac16990f17afc96be61940d.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_4006f9694ac16990f17afc96be61940d.jpg saved to cache
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6f9e2d0>
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_665952e5bd8d90a61a99685aeadc1886.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_665952e5bd8d90a61a99685aeadc1886.jpg saved to cache
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:52 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU62289%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for EU62289: 2
2026-03-28 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe980d87-d851-5789-a98a-0f9b8c0e2819 with identifier: EU62289
2026-03-28 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe980d87-d851-5789-a98a-0f9b8c0e2819 with scrape type 2
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe980d87-d851-5789-a98a-0f9b8c0e2819 with scrape type 2
2026-03-28 08:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fe980d87-d851-5789-a98a-0f9b8c0e2819, identifier: EU62289
2026-03-28 08:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_c7bf6acd267834fb548497a8994e2337.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fe980d87-d851-5789-a98a-0f9b8c0e2819 with identifier: EU62289
2026-03-28 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fe980d87-d851-5789-a98a-0f9b8c0e2819 with identifier: EU62289
2026-03-28 08:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fe980d87-d851-5789-a98a-0f9b8c0e2819 with identifier: EU62289 to the API
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:02:33Z',
 'fuel_type': 'petrol',
 'id': 'fe980d87-d851-5789-a98a-0f9b8c0e2819',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU62289',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 201201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU62289%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Saving data for EU62289: {'auction_closing_time': 1774713753.0, 'created_time': 1774471125.608337, 'last_price_update_time': 1774686952.577596}
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU62289') HTTP/1.1" 204 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF40273%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for YF40273: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH30418%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for KH30418: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX63098%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for KX63098: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK71488%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for CK71488: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR44504%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for MR44504: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-28 08:35:52 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU20603%27 HTTP/1.1" 200 None
2026-03-28 08:35:52 [auto1.be] INFO: Scrape type for BU20603: 2
2026-03-28 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6d1eb1-6b60-5f98-aee3-313f122cf145 with identifier: BU20603
2026-03-28 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6d1eb1-6b60-5f98-aee3-313f122cf145 with scrape type 2
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f6d1eb1-6b60-5f98-aee3-313f122cf145 with scrape type 2
2026-03-28 08:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f6d1eb1-6b60-5f98-aee3-313f122cf145, identifier: BU20603
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3bc057090>
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_1ff87c0a1d9ed20c91c451be8045db7d.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1ff87c0a1d9ed20c91c451be8045db7d.jpg saved to cache
2026-03-28 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f6d1eb1-6b60-5f98-aee3-313f122cf145 with identifier: BU20603
2026-03-28 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f6d1eb1-6b60-5f98-aee3-313f122cf145 with identifier: BU20603
2026-03-28 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f6d1eb1-6b60-5f98-aee3-313f122cf145 with identifier: BU20603 to the API
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:12:12Z',
 'fuel_type': 'petrol',
 'id': '4f6d1eb1-6b60-5f98-aee3-313f122cf145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU20603',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 101313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU20603%27 HTTP/1.1" 200 None
2026-03-28 08:35:53 [auto1.be] INFO: Saving data for BU20603: {'auction_closing_time': 1774714332.0, 'created_time': 1774471339.227219, 'last_price_update_time': 1774686953.264267}
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU20603') HTTP/1.1" 204 0
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-28 08:35:53 [auto1.be] INFO: Scrape type for LT82149: 0
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF99667%27 HTTP/1.1" 200 None
2026-03-28 08:35:53 [auto1.be] INFO: Scrape type for VF99667: 0
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-28 08:35:53 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b64dabd0>
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_1741e7acb6787ba9524ce0647a886f2a.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1741e7acb6787ba9524ce0647a886f2a.jpg saved to cache
2026-03-28 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb3b6e18550>
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fed%252F9eedcdc78ceb5b0f71fc4652923e1ec3%252Fpa%252FTS84713_c7bf6acd267834fb548497a8994e2337.jpg') HTTP/1.1" 204 0
2026-03-28 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_c7bf6acd267834fb548497a8994e2337.jpg saved to cache
2026-03-28 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5305e02-626b-571c-9d4c-427af525642d
2026-03-28 08:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5305e02-626b-571c-9d4c-427af525642d, skipping ID generation
2026-03-28 08:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5305e02-626b-571c-9d4c-427af525642d with scrape type 1
2026-03-28 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5305e02-626b-571c-9d4c-427af525642d sending to next pipeline
2026-03-28 08:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5305e02-626b-571c-9d4c-427af525642d, identifier: TS84713
2026-03-28 08:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-28 08:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-28 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713 to the API
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_c7bf6acd267834fb548497a8994e2337.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:33:12Z',
 'fuel_type': 'petrol',
 'id': 'e5305e02-626b-571c-9d4c-427af525642d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS84713',
 'listing': 'auction',
 'location': 'BE, Wanze',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 164241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_9c4b8b4b3036f2b4b10ef9d2d3396b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_665952e5bd8d90a61a99685aeadc1886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_4006f9694ac16990f17afc96be61940d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1ff87c0a1d9ed20c91c451be8045db7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_1741e7acb6787ba9524ce0647a886f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5305e02-626b-571c-9d4c-427af525642d/e5305e02-626b-571c-9d4c-427af525642d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/ed/9eedcdc78ceb5b0f71fc4652923e1ec3/pa/TS84713_c7bf6acd267834fb548497a8994e2337.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-28 08:35:53 [auto1.be] INFO: Saving data for TS84713: {'created_time': 1774686953.952962, 'last_price_update_time': 1774686953.952973, 'auction_closing_time': 1774884792.0}
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS84713') HTTP/1.1" 204 0
2026-03-28 08:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:55 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF90058%27 HTTP/1.1" 200 None
2026-03-28 08:35:55 [auto1.be] INFO: Scrape type for XF90058: 0
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG55963%27 HTTP/1.1" 200 None
2026-03-28 08:35:55 [auto1.be] INFO: Scrape type for WG55963: 0
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK47918%27 HTTP/1.1" 200 None
2026-03-28 08:35:55 [auto1.be] INFO: Scrape type for LK47918: 0
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT24920%27 HTTP/1.1" 200 None
2026-03-28 08:35:55 [auto1.be] INFO: Scrape type for GT24920: 0
2026-03-28 08:35:55 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK78813%27 HTTP/1.1" 200 None
2026-03-28 08:35:55 [auto1.be] INFO: Scrape type for CK78813: 2
2026-03-28 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc12ff97-9def-5b4f-b67b-7c4d7991b7ea with identifier: CK78813
2026-03-28 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc12ff97-9def-5b4f-b67b-7c4d7991b7ea with scrape type 2
2026-03-28 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc12ff97-9def-5b4f-b67b-7c4d7991b7ea with scrape type 2
2026-03-28 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc12ff97-9def-5b4f-b67b-7c4d7991b7ea, identifier: CK78813
2026-03-28 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc12ff97-9def-5b4f-b67b-7c4d7991b7ea with identifier: CK78813
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc12ff97-9def-5b4f-b67b-7c4d7991b7ea with identifier: CK78813
2026-03-28 08:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc12ff97-9def-5b4f-b67b-7c4d7991b7ea with identifier: CK78813 to the API
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:59:31Z',
 'fuel_type': 'petrol',
 'id': 'fc12ff97-9def-5b4f-b67b-7c4d7991b7ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK78813',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 215543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-25',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK78813%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Saving data for CK78813: {'auction_closing_time': 1774717171.0, 'created_time': 1773237953.696916, 'last_price_update_time': 1774686956.024944}
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK78813') HTTP/1.1" 204 0
2026-03-28 08:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL07479%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for FL07479: 0
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV70453%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for KV70453: 0
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT18330%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for BT18330: 2
2026-03-28 08:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdff0617-2a1b-556c-ad4a-5aebbb1baf22 with identifier: BT18330
2026-03-28 08:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdff0617-2a1b-556c-ad4a-5aebbb1baf22 with scrape type 2
2026-03-28 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdff0617-2a1b-556c-ad4a-5aebbb1baf22 with scrape type 2
2026-03-28 08:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bdff0617-2a1b-556c-ad4a-5aebbb1baf22, identifier: BT18330
2026-03-28 08:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bdff0617-2a1b-556c-ad4a-5aebbb1baf22 with identifier: BT18330
2026-03-28 08:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bdff0617-2a1b-556c-ad4a-5aebbb1baf22 with identifier: BT18330
2026-03-28 08:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bdff0617-2a1b-556c-ad4a-5aebbb1baf22 with identifier: BT18330 to the API
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:56Z',
 'fuel_type': 'diesel',
 'id': 'bdff0617-2a1b-556c-ad4a-5aebbb1baf22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT18330',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 136414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-11',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT18330%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Saving data for BT18330: {'auction_closing_time': 1774714856.0, 'created_time': 1774471299.553242, 'last_price_update_time': 1774686956.66584}
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT18330') HTTP/1.1" 204 0
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF01400%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for JF01400: 0
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 08:35:56 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL13165%27 HTTP/1.1" 200 None
2026-03-28 08:35:56 [auto1.be] INFO: Scrape type for VL13165: 2
2026-03-28 08:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310bc77a-b880-5a0a-8e8c-14de0c21c7e9 with identifier: VL13165
2026-03-28 08:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310bc77a-b880-5a0a-8e8c-14de0c21c7e9 with scrape type 2
2026-03-28 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310bc77a-b880-5a0a-8e8c-14de0c21c7e9 with scrape type 2
2026-03-28 08:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 310bc77a-b880-5a0a-8e8c-14de0c21c7e9, identifier: VL13165
2026-03-28 08:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 310bc77a-b880-5a0a-8e8c-14de0c21c7e9 with identifier: VL13165
2026-03-28 08:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 310bc77a-b880-5a0a-8e8c-14de0c21c7e9 with identifier: VL13165
2026-03-28 08:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 310bc77a-b880-5a0a-8e8c-14de0c21c7e9 with identifier: VL13165 to the API
2026-03-28 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:34:51Z',
 'fuel_type': 'petrol',
 'id': '310bc77a-b880-5a0a-8e8c-14de0c21c7e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL13165',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 55563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-19',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL13165%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Saving data for VL13165: {'auction_closing_time': 1774715691.0, 'created_time': 1774471306.282411, 'last_price_update_time': 1774686957.117482}
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL13165') HTTP/1.1" 204 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for WN85390: 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV74957%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for KV74957: 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for YB46987: 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ37534%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for YJ37534: 2
2026-03-28 08:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7 with identifier: YJ37534
2026-03-28 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7 with scrape type 2
2026-03-28 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7 with scrape type 2
2026-03-28 08:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7, identifier: YJ37534
2026-03-28 08:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7 with identifier: YJ37534
2026-03-28 08:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7 with identifier: YJ37534
2026-03-28 08:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7 with identifier: YJ37534 to the API
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:02:57Z',
 'fuel_type': 'diesel',
 'id': '34ef4b42-c8f6-589f-9ebe-d6b0c98cd6e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ37534',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 73026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ37534%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Saving data for YJ37534: {'auction_closing_time': 1774713777.0, 'created_time': 1774471370.238038, 'last_price_update_time': 1774686957.675597}
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ37534') HTTP/1.1" 204 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for TY97185: 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-28 08:35:57 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG04214%27 HTTP/1.1" 200 None
2026-03-28 08:35:57 [auto1.be] INFO: Scrape type for CG04214: 2
2026-03-28 08:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f0901f7-cf6b-5130-9ca9-70d198c5400d with identifier: CG04214
2026-03-28 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f0901f7-cf6b-5130-9ca9-70d198c5400d with scrape type 2
2026-03-28 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f0901f7-cf6b-5130-9ca9-70d198c5400d with scrape type 2
2026-03-28 08:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f0901f7-cf6b-5130-9ca9-70d198c5400d, identifier: CG04214
2026-03-28 08:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f0901f7-cf6b-5130-9ca9-70d198c5400d with identifier: CG04214
2026-03-28 08:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f0901f7-cf6b-5130-9ca9-70d198c5400d with identifier: CG04214
2026-03-28 08:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f0901f7-cf6b-5130-9ca9-70d198c5400d with identifier: CG04214 to the API
2026-03-28 08:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:19:31Z',
 'fuel_type': 'hybrid',
 'id': '8f0901f7-cf6b-5130-9ca9-70d198c5400d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG04214',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 81556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-16',
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG04214%27 HTTP/1.1" 200 None
2026-03-28 08:35:58 [auto1.be] INFO: Saving data for CG04214: {'auction_closing_time': 1774714771.0, 'created_time': 1774471419.082005, 'last_price_update_time': 1774686958.153694}
2026-03-28 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG04214') HTTP/1.1" 204 0
2026-03-28 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:35:59 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1704 | hits on page: 40
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH51844%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for BH51844: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ18869%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for DZ18869: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC57264%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for PC57264: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN83226%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for GN83226: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD12029%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for RD12029: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ07927%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for RZ07927: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR81556%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for LR81556: 2
2026-03-28 08:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb3de6fd-023b-532e-a12f-09fee36664c6 with identifier: LR81556
2026-03-28 08:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb3de6fd-023b-532e-a12f-09fee36664c6 with scrape type 2
2026-03-28 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb3de6fd-023b-532e-a12f-09fee36664c6 with scrape type 2
2026-03-28 08:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb3de6fd-023b-532e-a12f-09fee36664c6, identifier: LR81556
2026-03-28 08:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb3de6fd-023b-532e-a12f-09fee36664c6 with identifier: LR81556
2026-03-28 08:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb3de6fd-023b-532e-a12f-09fee36664c6 with identifier: LR81556
2026-03-28 08:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb3de6fd-023b-532e-a12f-09fee36664c6 with identifier: LR81556 to the API
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:39Z',
 'fuel_type': 'diesel',
 'id': 'fb3de6fd-023b-532e-a12f-09fee36664c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR81556',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 340234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-03',
 'seller_name': None,
 'title': 'Lancia Delta 1.6 Diesel Oro',
 'transmission': 'automatic',
 'trim': 'Oro',
 'year': 2011}
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR81556%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Saving data for LR81556: {'auction_closing_time': 1774714479.0, 'created_time': 1774471355.396998, 'last_price_update_time': 1774686959.764029}
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LR81556') HTTP/1.1" 204 0
2026-03-28 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-28 08:35:59 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ84188%27 HTTP/1.1" 200 None
2026-03-28 08:35:59 [auto1.be] INFO: Scrape type for UJ84188: 2
2026-03-28 08:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b6ade4-0a0d-50e2-8787-2734312d61d7 with identifier: UJ84188
2026-03-28 08:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b6ade4-0a0d-50e2-8787-2734312d61d7 with scrape type 2
2026-03-28 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1b6ade4-0a0d-50e2-8787-2734312d61d7 with scrape type 2
2026-03-28 08:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1b6ade4-0a0d-50e2-8787-2734312d61d7, identifier: UJ84188
2026-03-28 08:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1b6ade4-0a0d-50e2-8787-2734312d61d7 with identifier: UJ84188
2026-03-28 08:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1b6ade4-0a0d-50e2-8787-2734312d61d7 with identifier: UJ84188
2026-03-28 08:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1b6ade4-0a0d-50e2-8787-2734312d61d7 with identifier: UJ84188 to the API
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:05Z',
 'fuel_type': 'petrol',
 'id': 'f1b6ade4-0a0d-50e2-8787-2734312d61d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ84188',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 157858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2016}
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ84188%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Saving data for UJ84188: {'auction_closing_time': 1774716005.0, 'created_time': 1774471301.028241, 'last_price_update_time': 1774686960.275712}
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ84188') HTTP/1.1" 204 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for JR35998: 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW50978%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for TW50978: 2
2026-03-28 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b with identifier: TW50978
2026-03-28 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b with scrape type 2
2026-03-28 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b with scrape type 2
2026-03-28 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b, identifier: TW50978
2026-03-28 08:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b with identifier: TW50978
2026-03-28 08:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b with identifier: TW50978
2026-03-28 08:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b with identifier: TW50978 to the API
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:52Z',
 'fuel_type': 'diesel',
 'id': '933b1f4f-bcc1-5f0c-98a9-03b4f4193b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW50978',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 200879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2014}
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW50978%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Saving data for TW50978: {'auction_closing_time': 1774714492.0, 'created_time': 1774471343.085574, 'last_price_update_time': 1774686960.754573}
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW50978') HTTP/1.1" 204 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE86423%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for GE86423: 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE10158%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for AE10158: 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW03008%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for PW03008: 0
2026-03-28 08:36:00 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ92015%27 HTTP/1.1" 200 None
2026-03-28 08:36:00 [auto1.be] INFO: Scrape type for DJ92015: 2
2026-03-28 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177 with identifier: DJ92015
2026-03-28 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177 with scrape type 2
2026-03-28 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177 with scrape type 2
2026-03-28 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177, identifier: DJ92015
2026-03-28 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177 with identifier: DJ92015
2026-03-28 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177 with identifier: DJ92015
2026-03-28 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177 with identifier: DJ92015 to the API
2026-03-28 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:57Z',
 'fuel_type': 'petrol',
 'id': 'd5d4af0b-51c4-5ab8-b51b-0f7ba4ed3177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ92015',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 116637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-16',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ92015%27 HTTP/1.1" 200 None
2026-03-28 08:36:01 [auto1.be] INFO: Saving data for DJ92015: {'auction_closing_time': 1774715337.0, 'created_time': 1774471372.696942, 'last_price_update_time': 1774686961.375966}
2026-03-28 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ92015') HTTP/1.1" 204 0
2026-03-28 08:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:02 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM94904%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for RM94904: 0
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML32022%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for ML32022: 0
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC12895%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for YC12895: 2
2026-03-28 08:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2 with identifier: YC12895
2026-03-28 08:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2 with scrape type 2
2026-03-28 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2 with scrape type 2
2026-03-28 08:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2, identifier: YC12895
2026-03-28 08:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2 with identifier: YC12895
2026-03-28 08:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2 with identifier: YC12895
2026-03-28 08:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5dbb3463-f7e9-51cd-89d9-22874b9d7cf2 with identifier: YC12895 to the API
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:51:44Z',
 'fuel_type': 'diesel',
 'id': '5dbb3463-f7e9-51cd-89d9-22874b9d7cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC12895',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 23392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-12',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC12895%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Saving data for YC12895: {'auction_closing_time': 1774716704.0, 'created_time': 1774471090.226044, 'last_price_update_time': 1774686962.817501}
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC12895') HTTP/1.1" 204 0
2026-03-28 08:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF46667%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for DF46667: 0
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW94232%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for GW94232: 0
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD21641%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for TD21641: 0
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-28 08:36:02 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB55394%27 HTTP/1.1" 200 None
2026-03-28 08:36:02 [auto1.be] INFO: Scrape type for LB55394: 2
2026-03-28 08:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ef252f-c48e-5150-b80e-69ed6ac06601 with identifier: LB55394
2026-03-28 08:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ef252f-c48e-5150-b80e-69ed6ac06601 with scrape type 2
2026-03-28 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0ef252f-c48e-5150-b80e-69ed6ac06601 with scrape type 2
2026-03-28 08:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0ef252f-c48e-5150-b80e-69ed6ac06601, identifier: LB55394
2026-03-28 08:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0ef252f-c48e-5150-b80e-69ed6ac06601 with identifier: LB55394
2026-03-28 08:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0ef252f-c48e-5150-b80e-69ed6ac06601 with identifier: LB55394
2026-03-28 08:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0ef252f-c48e-5150-b80e-69ed6ac06601 with identifier: LB55394 to the API
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:12:52Z',
 'fuel_type': 'diesel',
 'id': 'f0ef252f-c48e-5150-b80e-69ed6ac06601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB55394',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 236881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-18',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB55394%27 HTTP/1.1" 200 None
2026-03-28 08:36:03 [auto1.be] INFO: Saving data for LB55394: {'auction_closing_time': 1774714372.0, 'created_time': 1774039034.876834, 'last_price_update_time': 1774686963.300183}
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LB55394') HTTP/1.1" 204 0
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-28 08:36:03 [auto1.be] INFO: Scrape type for AX27110: 0
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB85934%27 HTTP/1.1" 200 None
2026-03-28 08:36:03 [auto1.be] INFO: Scrape type for GB85934: 2
2026-03-28 08:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d3090a-8da5-5d01-ad07-68f923a4c765 with identifier: GB85934
2026-03-28 08:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d3090a-8da5-5d01-ad07-68f923a4c765 with scrape type 2
2026-03-28 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d3090a-8da5-5d01-ad07-68f923a4c765 with scrape type 2
2026-03-28 08:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b3d3090a-8da5-5d01-ad07-68f923a4c765, identifier: GB85934
2026-03-28 08:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b3d3090a-8da5-5d01-ad07-68f923a4c765 with identifier: GB85934
2026-03-28 08:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b3d3090a-8da5-5d01-ad07-68f923a4c765 with identifier: GB85934
2026-03-28 08:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b3d3090a-8da5-5d01-ad07-68f923a4c765 with identifier: GB85934 to the API
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-28T16:08:10Z',
 'fuel_type': 'hybrid',
 'id': 'b3d3090a-8da5-5d01-ad07-68f923a4c765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB85934',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 113683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P300e Hybrid R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2021}
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB85934%27 HTTP/1.1" 200 None
2026-03-28 08:36:03 [auto1.be] INFO: Saving data for GB85934: {'auction_closing_time': 1774714090.0, 'created_time': 1774471325.407653, 'last_price_update_time': 1774686963.8038}
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB85934') HTTP/1.1" 204 0
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-28 08:36:03 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR37992%27 HTTP/1.1" 200 None
2026-03-28 08:36:03 [auto1.be] INFO: Scrape type for PR37992: 2
2026-03-28 08:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36343e83-52b2-5e68-ae9c-64abbd7381d5 with identifier: PR37992
2026-03-28 08:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36343e83-52b2-5e68-ae9c-64abbd7381d5 with scrape type 2
2026-03-28 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36343e83-52b2-5e68-ae9c-64abbd7381d5 with scrape type 2
2026-03-28 08:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36343e83-52b2-5e68-ae9c-64abbd7381d5, identifier: PR37992
2026-03-28 08:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36343e83-52b2-5e68-ae9c-64abbd7381d5 with identifier: PR37992
2026-03-28 08:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36343e83-52b2-5e68-ae9c-64abbd7381d5 with identifier: PR37992
2026-03-28 08:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36343e83-52b2-5e68-ae9c-64abbd7381d5 with identifier: PR37992 to the API
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:44:25Z',
 'fuel_type': 'diesel',
 'id': '36343e83-52b2-5e68-ae9c-64abbd7381d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR37992',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 144804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR37992%27 HTTP/1.1" 200 None
2026-03-28 08:36:04 [auto1.be] INFO: Saving data for PR37992: {'auction_closing_time': 1774716265.0, 'created_time': 1774471328.641921, 'last_price_update_time': 1774686964.742286}
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR37992') HTTP/1.1" 204 0
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-28 08:36:04 [auto1.be] INFO: Scrape type for MD92482: 0
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-28 08:36:04 [auto1.be] INFO: Scrape type for HL89741: 0
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-28 08:36:04 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-28 08:36:04 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-28 08:36:04 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER13199%27 HTTP/1.1" 200 None
2026-03-28 08:36:04 [auto1.be] INFO: Scrape type for ER13199: 2
2026-03-28 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd43a8e2-fad0-517f-8223-8fc6d5b99432 with identifier: ER13199
2026-03-28 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd43a8e2-fad0-517f-8223-8fc6d5b99432 with scrape type 2
2026-03-28 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd43a8e2-fad0-517f-8223-8fc6d5b99432 with scrape type 2
2026-03-28 08:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd43a8e2-fad0-517f-8223-8fc6d5b99432, identifier: ER13199
2026-03-28 08:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd43a8e2-fad0-517f-8223-8fc6d5b99432 with identifier: ER13199
2026-03-28 08:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd43a8e2-fad0-517f-8223-8fc6d5b99432 with identifier: ER13199
2026-03-28 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd43a8e2-fad0-517f-8223-8fc6d5b99432 with identifier: ER13199 to the API
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:10:11Z',
 'fuel_type': 'diesel',
 'id': 'bd43a8e2-fad0-517f-8223-8fc6d5b99432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER13199',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 150961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-26',
 'seller_name': None,
 'title': 'Ford EcoSport 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER13199%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Saving data for ER13199: {'auction_closing_time': 1774714211.0, 'created_time': 1774471398.859717, 'last_price_update_time': 1774686965.232654}
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER13199') HTTP/1.1" 204 0
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM74317%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Scrape type for FM74317: 0
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN70818%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Scrape type for YN70818: 2
2026-03-28 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f96bc7a-8901-5096-b026-e4851e849f9d with identifier: YN70818
2026-03-28 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f96bc7a-8901-5096-b026-e4851e849f9d with scrape type 2
2026-03-28 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f96bc7a-8901-5096-b026-e4851e849f9d with scrape type 2
2026-03-28 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f96bc7a-8901-5096-b026-e4851e849f9d, identifier: YN70818
2026-03-28 08:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f96bc7a-8901-5096-b026-e4851e849f9d with identifier: YN70818
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 08:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f96bc7a-8901-5096-b026-e4851e849f9d with identifier: YN70818
2026-03-28 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f96bc7a-8901-5096-b026-e4851e849f9d with identifier: YN70818 to the API
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:37:13Z',
 'fuel_type': 'diesel',
 'id': '9f96bc7a-8901-5096-b026-e4851e849f9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN70818',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 129884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-07',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN70818%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Saving data for YN70818: {'auction_closing_time': 1774715833.0, 'created_time': 1774471099.198619, 'last_price_update_time': 1774686965.921129}
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN70818') HTTP/1.1" 204 0
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR10172%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Scrape type for WR10172: 0
2026-03-28 08:36:05 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ60295%27 HTTP/1.1" 200 None
2026-03-28 08:36:05 [auto1.be] INFO: Scrape type for DZ60295: 2
2026-03-28 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d with identifier: DZ60295
2026-03-28 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d with scrape type 2
2026-03-28 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d with scrape type 2
2026-03-28 08:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d, identifier: DZ60295
2026-03-28 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d with identifier: DZ60295
2026-03-28 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d with identifier: DZ60295
2026-03-28 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d with identifier: DZ60295 to the API
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:29:43Z',
 'fuel_type': 'petrol',
 'id': '9fcb2a0f-2e82-5fb9-a211-b1b9c6eb274d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ60295',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 166305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ60295%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Saving data for DZ60295: {'auction_closing_time': 1774715383.0, 'created_time': 1774038962.908699, 'last_price_update_time': 1774686966.384455}
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ60295') HTTP/1.1" 204 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for GW87029: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL95058%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for YL95058: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY14138%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for BY14138: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF17884%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for EF17884: 0
2026-03-28 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:06 [scrapy.extensions.logstats] INFO: Crawled 52 pages (at 52 pages/min), scraped 54 items (at 54 items/min)
2026-03-28 08:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-28 08:36:06 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN66713%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for CN66713: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ63633%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for EJ63633: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-28 08:36:06 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18687%27 HTTP/1.1" 200 None
2026-03-28 08:36:06 [auto1.be] INFO: Scrape type for CV18687: 2
2026-03-28 08:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d with identifier: CV18687
2026-03-28 08:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d with scrape type 2
2026-03-28 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d with scrape type 2
2026-03-28 08:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d, identifier: CV18687
2026-03-28 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d with identifier: CV18687
2026-03-28 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d with identifier: CV18687
2026-03-28 08:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d with identifier: CV18687 to the API
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:17:11Z',
 'fuel_type': 'petrol',
 'id': 'e0b05fbf-51e5-5a9f-8a04-e9925c5eb80d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV18687',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 210890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-20',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.5 Instyle',
 'transmission': 'manual',
 'trim': 'Instyle',
 'year': 2010}
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18687%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Saving data for CV18687: {'auction_closing_time': 1774714631.0, 'created_time': 1774471419.504024, 'last_price_update_time': 1774686967.23632}
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV18687') HTTP/1.1" 204 0
2026-03-28 08:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for NA97131: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for AM99393: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY49769%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for XY49769: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX92013%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for CX92013: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-28 08:36:07 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-28 08:36:07 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-28 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:08 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Scrape type for YB34897: 0
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB62754%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Scrape type for CB62754: 0
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Scrape type for KE03465: 0
2026-03-28 08:36:08 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84534%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Scrape type for BR84534: 2
2026-03-28 08:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59196e21-0114-59ac-8df4-df7a6ed5bbb5 with identifier: BR84534
2026-03-28 08:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59196e21-0114-59ac-8df4-df7a6ed5bbb5 with scrape type 2
2026-03-28 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59196e21-0114-59ac-8df4-df7a6ed5bbb5 with scrape type 2
2026-03-28 08:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 59196e21-0114-59ac-8df4-df7a6ed5bbb5, identifier: BR84534
2026-03-28 08:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 59196e21-0114-59ac-8df4-df7a6ed5bbb5 with identifier: BR84534
2026-03-28 08:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 59196e21-0114-59ac-8df4-df7a6ed5bbb5 with identifier: BR84534
2026-03-28 08:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 59196e21-0114-59ac-8df4-df7a6ed5bbb5 with identifier: BR84534 to the API
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:55:41Z',
 'fuel_type': 'diesel',
 'id': '59196e21-0114-59ac-8df4-df7a6ed5bbb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR84534',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 164245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84534%27 HTTP/1.1" 200 None
2026-03-28 08:36:08 [auto1.be] INFO: Saving data for BR84534: {'auction_closing_time': 1774716941.0, 'created_time': 1774471170.389416, 'last_price_update_time': 1774686968.996347}
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR84534') HTTP/1.1" 204 0
2026-03-28 08:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW31488%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for ZW31488: 0
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE01185%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for JE01185: 0
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for HU84368: 2
2026-03-28 08:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-28 08:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeb4fb4-43c5-5997-ba2e-31e160077d13 with scrape type 2
2026-03-28 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeb4fb4-43c5-5997-ba2e-31e160077d13 with scrape type 2
2026-03-28 08:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeb4fb4-43c5-5997-ba2e-31e160077d13, identifier: HU84368
2026-03-28 08:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-28 08:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-28 08:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368 to the API
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:08Z',
 'fuel_type': 'diesel',
 'id': 'deeb4fb4-43c5-5997-ba2e-31e160077d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU84368',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 212275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Saving data for HU84368: {'auction_closing_time': 1774715348.0, 'created_time': 1773780127.010949, 'last_price_update_time': 1774686969.538881}
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU84368') HTTP/1.1" 204 0
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE95179%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for CE95179: 0
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 08:36:09 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT01513%27 HTTP/1.1" 200 None
2026-03-28 08:36:09 [auto1.be] INFO: Scrape type for JT01513: 2
2026-03-28 08:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2e3d27-f1cf-58aa-895b-cdad05b799d8 with identifier: JT01513
2026-03-28 08:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2e3d27-f1cf-58aa-895b-cdad05b799d8 with scrape type 2
2026-03-28 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2e3d27-f1cf-58aa-895b-cdad05b799d8 with scrape type 2
2026-03-28 08:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec2e3d27-f1cf-58aa-895b-cdad05b799d8, identifier: JT01513
2026-03-28 08:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec2e3d27-f1cf-58aa-895b-cdad05b799d8 with identifier: JT01513
2026-03-28 08:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec2e3d27-f1cf-58aa-895b-cdad05b799d8 with identifier: JT01513
2026-03-28 08:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec2e3d27-f1cf-58aa-895b-cdad05b799d8 with identifier: JT01513 to the API
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:49Z',
 'fuel_type': 'petrol',
 'id': 'ec2e3d27-f1cf-58aa-895b-cdad05b799d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT01513',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 154016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT01513%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Saving data for JT01513: {'auction_closing_time': 1774715689.0, 'created_time': 1774471132.249266, 'last_price_update_time': 1774686970.249014}
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT01513') HTTP/1.1" 204 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for CP45384: 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-28 08:36:10 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW00167%27 HTTP/1.1" 200 None
2026-03-28 08:36:10 [auto1.be] INFO: Scrape type for CW00167: 0
2026-03-28 08:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:11 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for BH52169: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG88652%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for NG88652: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP41015%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for NP41015: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for TX28125: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ92859%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for SJ92859: 0
2026-03-28 08:36:11 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL08078%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Scrape type for SL08078: 2
2026-03-28 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f24378f8-74e7-5ed0-848f-31f20f1323f7 with identifier: SL08078
2026-03-28 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f24378f8-74e7-5ed0-848f-31f20f1323f7 with scrape type 2
2026-03-28 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f24378f8-74e7-5ed0-848f-31f20f1323f7 with scrape type 2
2026-03-28 08:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f24378f8-74e7-5ed0-848f-31f20f1323f7, identifier: SL08078
2026-03-28 08:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f24378f8-74e7-5ed0-848f-31f20f1323f7 with identifier: SL08078
2026-03-28 08:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f24378f8-74e7-5ed0-848f-31f20f1323f7 with identifier: SL08078
2026-03-28 08:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f24378f8-74e7-5ed0-848f-31f20f1323f7 with identifier: SL08078 to the API
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:54:05Z',
 'fuel_type': 'diesel',
 'id': 'f24378f8-74e7-5ed0-848f-31f20f1323f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL08078',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fullback',
 'odometer': 100146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-11',
 'seller_name': None,
 'title': 'Fiat Fullback 2.4 JTD Double Cab LX Silver + Adventure',
 'transmission': 'automatic',
 'trim': 'Double Cab LX Silver + Adventure',
 'year': 2019}
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL08078%27 HTTP/1.1" 200 None
2026-03-28 08:36:11 [auto1.be] INFO: Saving data for SL08078: {'auction_closing_time': 1774716845.0, 'created_time': 1774471379.448122, 'last_price_update_time': 1774686971.989596}
2026-03-28 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL08078') HTTP/1.1" 204 0
2026-03-28 08:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB55358%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for RB55358: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49722%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for TE49722: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU36315%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for PU36315: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN37079%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for NN37079: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44217%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for WZ44217: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR75863%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for NR75863: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-28 08:36:12 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-28 08:36:12 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-28 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:13 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP19111%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for SP19111: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF62281%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for BF62281: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM06752%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for KM06752: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ21578%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for KZ21578: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ29729%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for PJ29729: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for XT14784: 0
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-28 08:36:13 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY27857%27 HTTP/1.1" 200 None
2026-03-28 08:36:13 [auto1.be] INFO: Scrape type for ZY27857: 2
2026-03-28 08:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc83531-f674-5e24-abd9-5c221222e005 with identifier: ZY27857
2026-03-28 08:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc83531-f674-5e24-abd9-5c221222e005 with scrape type 2
2026-03-28 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc83531-f674-5e24-abd9-5c221222e005 with scrape type 2
2026-03-28 08:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1cc83531-f674-5e24-abd9-5c221222e005, identifier: ZY27857
2026-03-28 08:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1cc83531-f674-5e24-abd9-5c221222e005 with identifier: ZY27857
2026-03-28 08:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1cc83531-f674-5e24-abd9-5c221222e005 with identifier: ZY27857
2026-03-28 08:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1cc83531-f674-5e24-abd9-5c221222e005 with identifier: ZY27857 to the API
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:47:51Z',
 'fuel_type': 'petrol',
 'id': '1cc83531-f674-5e24-abd9-5c221222e005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY27857',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 212371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY27857%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Saving data for ZY27857: {'auction_closing_time': 1774716471.0, 'created_time': 1774471374.43625, 'last_price_update_time': 1774686974.086303}
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY27857') HTTP/1.1" 204 0
2026-03-28 08:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX65189%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for NX65189: 2
2026-03-28 08:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba58f37-5dfc-5bd5-926b-497f1d285ae5 with identifier: NX65189
2026-03-28 08:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba58f37-5dfc-5bd5-926b-497f1d285ae5 with scrape type 2
2026-03-28 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba58f37-5dfc-5bd5-926b-497f1d285ae5 with scrape type 2
2026-03-28 08:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ba58f37-5dfc-5bd5-926b-497f1d285ae5, identifier: NX65189
2026-03-28 08:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ba58f37-5dfc-5bd5-926b-497f1d285ae5 with identifier: NX65189
2026-03-28 08:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ba58f37-5dfc-5bd5-926b-497f1d285ae5 with identifier: NX65189
2026-03-28 08:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ba58f37-5dfc-5bd5-926b-497f1d285ae5 with identifier: NX65189 to the API
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:14Z',
 'fuel_type': 'diesel',
 'id': '3ba58f37-5dfc-5bd5-926b-497f1d285ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX65189',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX65189%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Saving data for NX65189: {'auction_closing_time': 1774714454.0, 'created_time': 1774471204.324848, 'last_price_update_time': 1774686974.606962}
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NX65189') HTTP/1.1" 204 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN30379%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for WN30379: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for AX26323: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for DZ54195: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for FA45415: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS89988%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for DS89988: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY85639%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for HY85639: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP50395%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for RP50395: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-28 08:36:14 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM97787%27 HTTP/1.1" 200 None
2026-03-28 08:36:14 [auto1.be] INFO: Scrape type for XM97787: 0
2026-03-28 08:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:15 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:15 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-28 08:36:15 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-28 08:36:15 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-28 08:36:15 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR57009%27 HTTP/1.1" 200 None
2026-03-28 08:36:15 [auto1.be] INFO: Scrape type for TR57009: 0
2026-03-28 08:36:15 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV70837%27 HTTP/1.1" 200 None
2026-03-28 08:36:15 [auto1.be] INFO: Scrape type for FV70837: 2
2026-03-28 08:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5dc727-1d9e-597c-a57d-a1aff638c31f with identifier: FV70837
2026-03-28 08:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5dc727-1d9e-597c-a57d-a1aff638c31f with scrape type 2
2026-03-28 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b5dc727-1d9e-597c-a57d-a1aff638c31f with scrape type 2
2026-03-28 08:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b5dc727-1d9e-597c-a57d-a1aff638c31f, identifier: FV70837
2026-03-28 08:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b5dc727-1d9e-597c-a57d-a1aff638c31f with identifier: FV70837
2026-03-28 08:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b5dc727-1d9e-597c-a57d-a1aff638c31f with identifier: FV70837
2026-03-28 08:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b5dc727-1d9e-597c-a57d-a1aff638c31f with identifier: FV70837 to the API
2026-03-28 08:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:49Z',
 'fuel_type': 'diesel',
 'id': '6b5dc727-1d9e-597c-a57d-a1aff638c31f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV70837',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 112081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV70837%27 HTTP/1.1" 200 None
2026-03-28 08:36:16 [auto1.be] INFO: Saving data for FV70837: {'auction_closing_time': 1774715329.0, 'created_time': 1773834420.905554, 'last_price_update_time': 1774686976.18923}
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV70837') HTTP/1.1" 204 0
2026-03-28 08:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB39644%27 HTTP/1.1" 200 None
2026-03-28 08:36:16 [auto1.be] INFO: Scrape type for TB39644: 2
2026-03-28 08:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abebe3f8-254d-5df3-827a-43514e0cc6ee with identifier: TB39644
2026-03-28 08:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abebe3f8-254d-5df3-827a-43514e0cc6ee with scrape type 2
2026-03-28 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abebe3f8-254d-5df3-827a-43514e0cc6ee with scrape type 2
2026-03-28 08:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abebe3f8-254d-5df3-827a-43514e0cc6ee, identifier: TB39644
2026-03-28 08:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abebe3f8-254d-5df3-827a-43514e0cc6ee with identifier: TB39644
2026-03-28 08:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abebe3f8-254d-5df3-827a-43514e0cc6ee with identifier: TB39644
2026-03-28 08:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abebe3f8-254d-5df3-827a-43514e0cc6ee with identifier: TB39644 to the API
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:19:50Z',
 'fuel_type': 'petrol',
 'id': 'abebe3f8-254d-5df3-827a-43514e0cc6ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB39644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 84361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2020}
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB39644%27 HTTP/1.1" 200 None
2026-03-28 08:36:16 [auto1.be] INFO: Saving data for TB39644: {'auction_closing_time': 1774714790.0, 'created_time': 1774471175.613673, 'last_price_update_time': 1774686976.671347}
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TB39644') HTTP/1.1" 204 0
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN95173%27 HTTP/1.1" 200 None
2026-03-28 08:36:16 [auto1.be] INFO: Scrape type for KN95173: 0
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-28 08:36:16 [auto1.be] INFO: Scrape type for TU34385: 0
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-28 08:36:16 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB21597%27 HTTP/1.1" 200 None
2026-03-28 08:36:16 [auto1.be] INFO: Scrape type for RB21597: 2
2026-03-28 08:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d654fa9f-7d18-5b0d-8168-c62c33cf7871 with identifier: RB21597
2026-03-28 08:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d654fa9f-7d18-5b0d-8168-c62c33cf7871 with scrape type 2
2026-03-28 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d654fa9f-7d18-5b0d-8168-c62c33cf7871 with scrape type 2
2026-03-28 08:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d654fa9f-7d18-5b0d-8168-c62c33cf7871, identifier: RB21597
2026-03-28 08:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d654fa9f-7d18-5b0d-8168-c62c33cf7871 with identifier: RB21597
2026-03-28 08:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d654fa9f-7d18-5b0d-8168-c62c33cf7871 with identifier: RB21597
2026-03-28 08:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d654fa9f-7d18-5b0d-8168-c62c33cf7871 with identifier: RB21597 to the API
2026-03-28 08:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 398,
 'expiration_date': '2026-03-28T16:07:31Z',
 'fuel_type': 'hybrid',
 'id': 'd654fa9f-7d18-5b0d-8168-c62c33cf7871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB21597',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 101025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Recharge Plug-in Hybrid Inscription Business AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Business AWD',
 'year': 2021}
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB21597%27 HTTP/1.1" 200 None
2026-03-28 08:36:17 [auto1.be] INFO: Saving data for RB21597: {'auction_closing_time': 1774714051.0, 'created_time': 1774471130.736302, 'last_price_update_time': 1774686977.175129}
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB21597') HTTP/1.1" 204 0
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-28 08:36:17 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC36147%27 HTTP/1.1" 200 None
2026-03-28 08:36:17 [auto1.be] INFO: Scrape type for DC36147: 2
2026-03-28 08:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9466dc-3885-5111-9f89-16a4df0a5ea5 with identifier: DC36147
2026-03-28 08:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9466dc-3885-5111-9f89-16a4df0a5ea5 with scrape type 2
2026-03-28 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9466dc-3885-5111-9f89-16a4df0a5ea5 with scrape type 2
2026-03-28 08:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e9466dc-3885-5111-9f89-16a4df0a5ea5, identifier: DC36147
2026-03-28 08:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e9466dc-3885-5111-9f89-16a4df0a5ea5 with identifier: DC36147
2026-03-28 08:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e9466dc-3885-5111-9f89-16a4df0a5ea5 with identifier: DC36147
2026-03-28 08:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e9466dc-3885-5111-9f89-16a4df0a5ea5 with identifier: DC36147 to the API
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:40:42Z',
 'fuel_type': 'diesel',
 'id': '2e9466dc-3885-5111-9f89-16a4df0a5ea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC36147',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 134085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-03',
 'seller_name': None,
 'title': 'Opel Astra 1.3 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2009}
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC36147%27 HTTP/1.1" 200 None
2026-03-28 08:36:17 [auto1.be] INFO: Saving data for DC36147: {'auction_closing_time': 1774716042.0, 'created_time': 1774471421.269026, 'last_price_update_time': 1774686977.627491}
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC36147') HTTP/1.1" 204 0
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-28 08:36:17 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-28 08:36:17 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV03405%27 HTTP/1.1" 200 None
2026-03-28 08:36:17 [auto1.be] INFO: Scrape type for TV03405: 2
2026-03-28 08:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b4d9dcb-405e-5187-beb4-88071380c791 with identifier: TV03405
2026-03-28 08:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4d9dcb-405e-5187-beb4-88071380c791 with scrape type 2
2026-03-28 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b4d9dcb-405e-5187-beb4-88071380c791 with scrape type 2
2026-03-28 08:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b4d9dcb-405e-5187-beb4-88071380c791, identifier: TV03405
2026-03-28 08:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b4d9dcb-405e-5187-beb4-88071380c791 with identifier: TV03405
2026-03-28 08:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b4d9dcb-405e-5187-beb4-88071380c791 with identifier: TV03405
2026-03-28 08:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b4d9dcb-405e-5187-beb4-88071380c791 with identifier: TV03405 to the API
2026-03-28 08:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:45:47Z',
 'fuel_type': 'diesel',
 'id': '6b4d9dcb-405e-5187-beb4-88071380c791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV03405',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 174788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2019}
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV03405%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Saving data for TV03405: {'auction_closing_time': 1774716347.0, 'created_time': 1774471170.067376, 'last_price_update_time': 1774686978.146232}
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV03405') HTTP/1.1" 204 0
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT93863%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Scrape type for PT93863: 2
2026-03-28 08:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53dda623-6ab4-5dd0-9a90-6e9aba22c507 with identifier: PT93863
2026-03-28 08:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53dda623-6ab4-5dd0-9a90-6e9aba22c507 with scrape type 2
2026-03-28 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53dda623-6ab4-5dd0-9a90-6e9aba22c507 with scrape type 2
2026-03-28 08:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53dda623-6ab4-5dd0-9a90-6e9aba22c507, identifier: PT93863
2026-03-28 08:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53dda623-6ab4-5dd0-9a90-6e9aba22c507 with identifier: PT93863
2026-03-28 08:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53dda623-6ab4-5dd0-9a90-6e9aba22c507 with identifier: PT93863
2026-03-28 08:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53dda623-6ab4-5dd0-9a90-6e9aba22c507 with identifier: PT93863 to the API
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'petrol',
 'id': '53dda623-6ab4-5dd0-9a90-6e9aba22c507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT93863',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 85866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2008}
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT93863%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Saving data for PT93863: {'auction_closing_time': 1774715126.0, 'created_time': 1774471136.860726, 'last_price_update_time': 1774686978.572938}
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT93863') HTTP/1.1" 204 0
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT96766%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Scrape type for UT96766: 0
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-28 08:36:18 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF63760%27 HTTP/1.1" 200 None
2026-03-28 08:36:18 [auto1.be] INFO: Scrape type for NF63760: 2
2026-03-28 08:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900a2a04-6dec-5c84-9ad1-bda50f9ade68 with identifier: NF63760
2026-03-28 08:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900a2a04-6dec-5c84-9ad1-bda50f9ade68 with scrape type 2
2026-03-28 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 900a2a04-6dec-5c84-9ad1-bda50f9ade68 with scrape type 2
2026-03-28 08:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 900a2a04-6dec-5c84-9ad1-bda50f9ade68, identifier: NF63760
2026-03-28 08:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 900a2a04-6dec-5c84-9ad1-bda50f9ade68 with identifier: NF63760
2026-03-28 08:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 900a2a04-6dec-5c84-9ad1-bda50f9ade68 with identifier: NF63760
2026-03-28 08:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 900a2a04-6dec-5c84-9ad1-bda50f9ade68 with identifier: NF63760 to the API
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:29:34Z',
 'fuel_type': 'hybrid',
 'id': '900a2a04-6dec-5c84-9ad1-bda50f9ade68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF63760',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 48412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF63760%27 HTTP/1.1" 200 None
2026-03-28 08:36:19 [auto1.be] INFO: Saving data for NF63760: {'auction_closing_time': 1774715374.0, 'created_time': 1774471400.156184, 'last_price_update_time': 1774686979.059285}
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NF63760') HTTP/1.1" 204 0
2026-03-28 08:36:19 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-28 08:36:19 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-28 08:36:19 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-28 08:36:19 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-28 08:36:19 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-28 08:36:19 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-28 08:36:19 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32342%27 HTTP/1.1" 200 None
2026-03-28 08:36:19 [auto1.be] INFO: Scrape type for HU32342: 2
2026-03-28 08:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f543a7-5e10-5350-a9be-1e875a356f9b with identifier: HU32342
2026-03-28 08:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f543a7-5e10-5350-a9be-1e875a356f9b with scrape type 2
2026-03-28 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5f543a7-5e10-5350-a9be-1e875a356f9b with scrape type 2
2026-03-28 08:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a5f543a7-5e10-5350-a9be-1e875a356f9b, identifier: HU32342
2026-03-28 08:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a5f543a7-5e10-5350-a9be-1e875a356f9b with identifier: HU32342
2026-03-28 08:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a5f543a7-5e10-5350-a9be-1e875a356f9b with identifier: HU32342
2026-03-28 08:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a5f543a7-5e10-5350-a9be-1e875a356f9b with identifier: HU32342 to the API
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:11Z',
 'fuel_type': 'petrol',
 'id': 'a5f543a7-5e10-5350-a9be-1e875a356f9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU32342',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 113915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-11',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32342%27 HTTP/1.1" 200 None
2026-03-28 08:36:19 [auto1.be] INFO: Saving data for HU32342: {'auction_closing_time': 1774713671.0, 'created_time': 1774471229.271652, 'last_price_update_time': 1774686979.797436}
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU32342') HTTP/1.1" 204 0
2026-03-28 08:36:19 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB89666%27 HTTP/1.1" 200 None
2026-03-28 08:36:19 [auto1.be] INFO: Scrape type for HB89666: 2
2026-03-28 08:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181 with identifier: HB89666
2026-03-28 08:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181 with scrape type 2
2026-03-28 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181 with scrape type 2
2026-03-28 08:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181, identifier: HB89666
2026-03-28 08:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181 with identifier: HB89666
2026-03-28 08:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181 with identifier: HB89666
2026-03-28 08:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c1b1f01-0a48-50da-b3ab-a6cdb0e79181 with identifier: HB89666 to the API
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:51:54Z',
 'fuel_type': 'petrol',
 'id': '4c1b1f01-0a48-50da-b3ab-a6cdb0e79181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB89666',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 195392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-11',
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB89666%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Saving data for HB89666: {'auction_closing_time': 1774716714.0, 'created_time': 1774471340.535054, 'last_price_update_time': 1774686980.22416}
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB89666') HTTP/1.1" 204 0
2026-03-28 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-28 08:36:20 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for DZ24480: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD48468%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for JD48468: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR78742%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for JR78742: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE77274%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for VE77274: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 08:36:20 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN88473%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Scrape type for AN88473: 2
2026-03-28 08:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68b7b8b8-fdf3-58c9-b91b-83338be99f16 with identifier: AN88473
2026-03-28 08:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68b7b8b8-fdf3-58c9-b91b-83338be99f16 with scrape type 2
2026-03-28 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68b7b8b8-fdf3-58c9-b91b-83338be99f16 with scrape type 2
2026-03-28 08:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 68b7b8b8-fdf3-58c9-b91b-83338be99f16, identifier: AN88473
2026-03-28 08:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 68b7b8b8-fdf3-58c9-b91b-83338be99f16 with identifier: AN88473
2026-03-28 08:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 68b7b8b8-fdf3-58c9-b91b-83338be99f16 with identifier: AN88473
2026-03-28 08:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 68b7b8b8-fdf3-58c9-b91b-83338be99f16 with identifier: AN88473 to the API
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:04:51Z',
 'fuel_type': 'petrol',
 'id': '68b7b8b8-fdf3-58c9-b91b-83338be99f16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN88473',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 69512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN88473%27 HTTP/1.1" 200 None
2026-03-28 08:36:20 [auto1.be] INFO: Saving data for AN88473: {'auction_closing_time': 1774713891.0, 'created_time': 1774471173.470845, 'last_price_update_time': 1774686980.896552}
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AN88473') HTTP/1.1" 204 0
2026-03-28 08:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD10151%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Scrape type for DD10151: 0
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH59922%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Scrape type for TH59922: 0
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ74735%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Scrape type for CZ74735: 2
2026-03-28 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d33bcc66-7585-5fb2-9fae-85c5c041c9b5 with identifier: CZ74735
2026-03-28 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d33bcc66-7585-5fb2-9fae-85c5c041c9b5 with scrape type 2
2026-03-28 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d33bcc66-7585-5fb2-9fae-85c5c041c9b5 with scrape type 2
2026-03-28 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d33bcc66-7585-5fb2-9fae-85c5c041c9b5, identifier: CZ74735
2026-03-28 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d33bcc66-7585-5fb2-9fae-85c5c041c9b5 with identifier: CZ74735
2026-03-28 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d33bcc66-7585-5fb2-9fae-85c5c041c9b5 with identifier: CZ74735
2026-03-28 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d33bcc66-7585-5fb2-9fae-85c5c041c9b5 with identifier: CZ74735 to the API
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:12:17Z',
 'fuel_type': 'diesel',
 'id': 'd33bcc66-7585-5fb2-9fae-85c5c041c9b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ74735',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 195408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L1H1 2,9t Komfort',
 'transmission': 'manual',
 'trim': 'L1H1 2,9t Komfort',
 'year': 2018}
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ74735%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Saving data for CZ74735: {'auction_closing_time': 1774714337.0, 'created_time': 1774471353.540075, 'last_price_update_time': 1774686981.471606}
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CZ74735') HTTP/1.1" 204 0
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-28 08:36:21 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ90167%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Scrape type for YZ90167: 2
2026-03-28 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd66e084-9e60-519d-8f11-26b99b59995e with identifier: YZ90167
2026-03-28 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd66e084-9e60-519d-8f11-26b99b59995e with scrape type 2
2026-03-28 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd66e084-9e60-519d-8f11-26b99b59995e with scrape type 2
2026-03-28 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd66e084-9e60-519d-8f11-26b99b59995e, identifier: YZ90167
2026-03-28 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd66e084-9e60-519d-8f11-26b99b59995e with identifier: YZ90167
2026-03-28 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd66e084-9e60-519d-8f11-26b99b59995e with identifier: YZ90167
2026-03-28 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd66e084-9e60-519d-8f11-26b99b59995e with identifier: YZ90167 to the API
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:05:09Z',
 'fuel_type': 'petrol',
 'id': 'fd66e084-9e60-519d-8f11-26b99b59995e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ90167',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 68172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-18',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ90167%27 HTTP/1.1" 200 None
2026-03-28 08:36:21 [auto1.be] INFO: Saving data for YZ90167: {'auction_closing_time': 1774713909.0, 'created_time': 1774471046.418826, 'last_price_update_time': 1774686981.888371}
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ90167') HTTP/1.1" 204 0
2026-03-28 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:23 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Scrape type for RV20515: 0
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS47672%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Scrape type for VS47672: 0
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ90658%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Scrape type for BZ90658: 2
2026-03-28 08:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb73c590-703e-5f54-b0ee-c6fcee13f72e with identifier: BZ90658
2026-03-28 08:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb73c590-703e-5f54-b0ee-c6fcee13f72e with scrape type 2
2026-03-28 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb73c590-703e-5f54-b0ee-c6fcee13f72e with scrape type 2
2026-03-28 08:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb73c590-703e-5f54-b0ee-c6fcee13f72e, identifier: BZ90658
2026-03-28 08:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb73c590-703e-5f54-b0ee-c6fcee13f72e with identifier: BZ90658
2026-03-28 08:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb73c590-703e-5f54-b0ee-c6fcee13f72e with identifier: BZ90658
2026-03-28 08:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb73c590-703e-5f54-b0ee-c6fcee13f72e with identifier: BZ90658 to the API
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:50Z',
 'fuel_type': 'petrol',
 'id': 'bb73c590-703e-5f54-b0ee-c6fcee13f72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ90658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 23640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-19',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ90658%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Saving data for BZ90658: {'auction_closing_time': 1774717010.0, 'created_time': 1774471222.108513, 'last_price_update_time': 1774686983.785192}
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ90658') HTTP/1.1" 204 0
2026-03-28 08:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Scrape type for JZ31869: 0
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 08:36:23 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK49914%27 HTTP/1.1" 200 None
2026-03-28 08:36:23 [auto1.be] INFO: Scrape type for YK49914: 2
2026-03-28 08:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354 with identifier: YK49914
2026-03-28 08:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354 with scrape type 2
2026-03-28 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354 with scrape type 2
2026-03-28 08:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354, identifier: YK49914
2026-03-28 08:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354 with identifier: YK49914
2026-03-28 08:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354 with identifier: YK49914
2026-03-28 08:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354 with identifier: YK49914 to the API
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:44Z',
 'fuel_type': 'diesel',
 'id': '658e2fc8-8ad4-52bc-b6c5-dfcf2cdf3354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK49914',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 189822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK49914%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Saving data for YK49914: {'auction_closing_time': 1774716404.0, 'created_time': 1774471383.753958, 'last_price_update_time': 1774686984.230042}
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK49914') HTTP/1.1" 204 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for TG38013: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for BN53670: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for NN42676: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for GC32489: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for WP70532: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for AN69845: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH50870%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for AH50870: 0
2026-03-28 08:36:24 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-28 08:36:24 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-28 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:29 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF91319%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for TF91319: 0
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS30497%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for KS30497: 2
2026-03-28 08:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee2fa1fb-582e-5e6d-a494-92eb779bf3f3 with identifier: KS30497
2026-03-28 08:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee2fa1fb-582e-5e6d-a494-92eb779bf3f3 with scrape type 2
2026-03-28 08:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee2fa1fb-582e-5e6d-a494-92eb779bf3f3 with scrape type 2
2026-03-28 08:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee2fa1fb-582e-5e6d-a494-92eb779bf3f3, identifier: KS30497
2026-03-28 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee2fa1fb-582e-5e6d-a494-92eb779bf3f3 with identifier: KS30497
2026-03-28 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee2fa1fb-582e-5e6d-a494-92eb779bf3f3 with identifier: KS30497
2026-03-28 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee2fa1fb-582e-5e6d-a494-92eb779bf3f3 with identifier: KS30497 to the API
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:21:46Z',
 'fuel_type': 'petrol',
 'id': 'ee2fa1fb-582e-5e6d-a494-92eb779bf3f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS30497',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'X-TYPE',
 'odometer': 220473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-30',
 'seller_name': None,
 'title': 'Jaguar X-TYPE 2.5 V6 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2007}
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS30497%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Saving data for KS30497: {'auction_closing_time': 1774714906.0, 'created_time': 1774471328.260626, 'last_price_update_time': 1774686989.540649}
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS30497') HTTP/1.1" 204 0
2026-03-28 08:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-28 08:36:29 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08447%27 HTTP/1.1" 200 None
2026-03-28 08:36:29 [auto1.be] INFO: Scrape type for GU08447: 2
2026-03-28 08:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d55a260-b725-5f7d-88ce-72453286dab4 with identifier: GU08447
2026-03-28 08:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d55a260-b725-5f7d-88ce-72453286dab4 with scrape type 2
2026-03-28 08:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d55a260-b725-5f7d-88ce-72453286dab4 with scrape type 2
2026-03-28 08:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d55a260-b725-5f7d-88ce-72453286dab4, identifier: GU08447
2026-03-28 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d55a260-b725-5f7d-88ce-72453286dab4 with identifier: GU08447
2026-03-28 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d55a260-b725-5f7d-88ce-72453286dab4 with identifier: GU08447
2026-03-28 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d55a260-b725-5f7d-88ce-72453286dab4 with identifier: GU08447 to the API
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:14:41Z',
 'fuel_type': 'diesel',
 'id': '6d55a260-b725-5f7d-88ce-72453286dab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU08447',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 180232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2009}
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08447%27 HTTP/1.1" 200 None
2026-03-28 08:36:30 [auto1.be] INFO: Saving data for GU08447: {'auction_closing_time': 1774714481.0, 'created_time': 1774471149.397045, 'last_price_update_time': 1774686990.078864}
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GU08447') HTTP/1.1" 204 0
2026-03-28 08:36:30 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE01545%27 HTTP/1.1" 200 None
2026-03-28 08:36:30 [auto1.be] INFO: Scrape type for SE01545: 2
2026-03-28 08:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a35c1600-516e-56af-beb8-60d715551dd6 with identifier: SE01545
2026-03-28 08:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a35c1600-516e-56af-beb8-60d715551dd6 with scrape type 2
2026-03-28 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a35c1600-516e-56af-beb8-60d715551dd6 with scrape type 2
2026-03-28 08:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a35c1600-516e-56af-beb8-60d715551dd6, identifier: SE01545
2026-03-28 08:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a35c1600-516e-56af-beb8-60d715551dd6 with identifier: SE01545
2026-03-28 08:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a35c1600-516e-56af-beb8-60d715551dd6 with identifier: SE01545
2026-03-28 08:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a35c1600-516e-56af-beb8-60d715551dd6 with identifier: SE01545 to the API
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:16:07Z',
 'fuel_type': 'hybrid',
 'id': 'a35c1600-516e-56af-beb8-60d715551dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE01545',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 60857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-06',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Collection',
 'transmission': 'automatic',
 'trim': 'Collection',
 'year': 2015}
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE01545%27 HTTP/1.1" 200 None
2026-03-28 08:36:30 [auto1.be] INFO: Saving data for SE01545: {'auction_closing_time': 1774714567.0, 'created_time': 1774471330.153104, 'last_price_update_time': 1774686990.517044}
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE01545') HTTP/1.1" 204 0
2026-03-28 08:36:30 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-28 08:36:30 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF05397%27 HTTP/1.1" 200 None
2026-03-28 08:36:30 [auto1.be] INFO: Scrape type for JF05397: 2
2026-03-28 08:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3b647a-c06e-5c04-a703-87fa06309b85 with identifier: JF05397
2026-03-28 08:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3b647a-c06e-5c04-a703-87fa06309b85 with scrape type 2
2026-03-28 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca3b647a-c06e-5c04-a703-87fa06309b85 with scrape type 2
2026-03-28 08:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca3b647a-c06e-5c04-a703-87fa06309b85, identifier: JF05397
2026-03-28 08:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca3b647a-c06e-5c04-a703-87fa06309b85 with identifier: JF05397
2026-03-28 08:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca3b647a-c06e-5c04-a703-87fa06309b85 with identifier: JF05397
2026-03-28 08:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca3b647a-c06e-5c04-a703-87fa06309b85 with identifier: JF05397 to the API
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:46:49Z',
 'fuel_type': 'diesel',
 'id': 'ca3b647a-c06e-5c04-a703-87fa06309b85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF05397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 114844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2013}
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF05397%27 HTTP/1.1" 200 None
2026-03-28 08:36:30 [auto1.be] INFO: Saving data for JF05397: {'auction_closing_time': 1774716409.0, 'created_time': 1774471385.603547, 'last_price_update_time': 1774686990.920782}
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF05397') HTTP/1.1" 204 0
2026-03-28 08:36:30 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 08:36:30 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-28 08:36:30 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV64637%27 HTTP/1.1" 200 None
2026-03-28 08:36:30 [auto1.be] INFO: Scrape type for ZV64637: 2
2026-03-28 08:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d277f537-c396-5ea6-b072-d1c9da965aca with identifier: ZV64637
2026-03-28 08:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d277f537-c396-5ea6-b072-d1c9da965aca with scrape type 2
2026-03-28 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d277f537-c396-5ea6-b072-d1c9da965aca with scrape type 2
2026-03-28 08:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d277f537-c396-5ea6-b072-d1c9da965aca, identifier: ZV64637
2026-03-28 08:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d277f537-c396-5ea6-b072-d1c9da965aca with identifier: ZV64637
2026-03-28 08:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d277f537-c396-5ea6-b072-d1c9da965aca with identifier: ZV64637
2026-03-28 08:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d277f537-c396-5ea6-b072-d1c9da965aca with identifier: ZV64637 to the API
2026-03-28 08:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:49:09Z',
 'fuel_type': 'petrol',
 'id': 'd277f537-c396-5ea6-b072-d1c9da965aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV64637',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 146462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-20',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV64637%27 HTTP/1.1" 200 None
2026-03-28 08:36:31 [auto1.be] INFO: Saving data for ZV64637: {'auction_closing_time': 1774716549.0, 'created_time': 1774471243.953064, 'last_price_update_time': 1774686991.982907}
2026-03-28 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV64637') HTTP/1.1" 204 0
2026-03-28 08:36:32 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS12412%27 HTTP/1.1" 200 None
2026-03-28 08:36:32 [auto1.be] INFO: Scrape type for JS12412: 0
2026-03-28 08:36:32 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW35122%27 HTTP/1.1" 200 None
2026-03-28 08:36:32 [auto1.be] INFO: Scrape type for YW35122: 0
2026-03-28 08:36:32 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP65458%27 HTTP/1.1" 200 None
2026-03-28 08:36:32 [auto1.be] INFO: Scrape type for VP65458: 2
2026-03-28 08:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5493178f-438c-59eb-8048-0ee231767faf with identifier: VP65458
2026-03-28 08:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5493178f-438c-59eb-8048-0ee231767faf with scrape type 2
2026-03-28 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5493178f-438c-59eb-8048-0ee231767faf with scrape type 2
2026-03-28 08:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5493178f-438c-59eb-8048-0ee231767faf, identifier: VP65458
2026-03-28 08:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5493178f-438c-59eb-8048-0ee231767faf with identifier: VP65458
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 08:36:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5493178f-438c-59eb-8048-0ee231767faf with identifier: VP65458
2026-03-28 08:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5493178f-438c-59eb-8048-0ee231767faf with identifier: VP65458 to the API
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:03:22Z',
 'fuel_type': 'diesel',
 'id': '5493178f-438c-59eb-8048-0ee231767faf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP65458',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 136419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2015}
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP65458%27 HTTP/1.1" 200 None
2026-03-28 08:36:32 [auto1.be] INFO: Saving data for VP65458: {'auction_closing_time': 1774713802.0, 'created_time': 1773301943.108801, 'last_price_update_time': 1774686992.636695}
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP65458') HTTP/1.1" 204 0
2026-03-28 08:36:32 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-28 08:36:32 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK31036%27 HTTP/1.1" 200 None
2026-03-28 08:36:32 [auto1.be] INFO: Scrape type for XK31036: 2
2026-03-28 08:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5dfcdea-38dd-503f-9f47-2eab1ea14c2c with identifier: XK31036
2026-03-28 08:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5dfcdea-38dd-503f-9f47-2eab1ea14c2c with scrape type 2
2026-03-28 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5dfcdea-38dd-503f-9f47-2eab1ea14c2c with scrape type 2
2026-03-28 08:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5dfcdea-38dd-503f-9f47-2eab1ea14c2c, identifier: XK31036
2026-03-28 08:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5dfcdea-38dd-503f-9f47-2eab1ea14c2c with identifier: XK31036
2026-03-28 08:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5dfcdea-38dd-503f-9f47-2eab1ea14c2c with identifier: XK31036
2026-03-28 08:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5dfcdea-38dd-503f-9f47-2eab1ea14c2c with identifier: XK31036 to the API
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:41:26Z',
 'fuel_type': 'diesel',
 'id': 'b5dfcdea-38dd-503f-9f47-2eab1ea14c2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK31036',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 284450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-22',
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK31036%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Saving data for XK31036: {'auction_closing_time': 1774716086.0, 'created_time': 1774471387.888894, 'last_price_update_time': 1774686993.046478}
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK31036') HTTP/1.1" 204 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for TH69152: 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM09750%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for UM09750: 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for KM78271: 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for ET07668: 0
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 08:36:33 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE24792%27 HTTP/1.1" 200 None
2026-03-28 08:36:33 [auto1.be] INFO: Scrape type for WE24792: 0
2026-03-28 08:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:37 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:37 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-28 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP41494%27 HTTP/1.1" 200 None
2026-03-28 08:36:37 [auto1.be] INFO: Scrape type for SP41494: 0
2026-03-28 08:36:37 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-28 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA31821%27 HTTP/1.1" 200 None
2026-03-28 08:36:37 [auto1.be] INFO: Scrape type for YA31821: 2
2026-03-28 08:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 290ecde7-a34b-56b5-8be0-3b2fb792b0e7 with identifier: YA31821
2026-03-28 08:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 290ecde7-a34b-56b5-8be0-3b2fb792b0e7 with scrape type 2
2026-03-28 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 290ecde7-a34b-56b5-8be0-3b2fb792b0e7 with scrape type 2
2026-03-28 08:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 290ecde7-a34b-56b5-8be0-3b2fb792b0e7, identifier: YA31821
2026-03-28 08:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 290ecde7-a34b-56b5-8be0-3b2fb792b0e7 with identifier: YA31821
2026-03-28 08:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 290ecde7-a34b-56b5-8be0-3b2fb792b0e7 with identifier: YA31821
2026-03-28 08:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 290ecde7-a34b-56b5-8be0-3b2fb792b0e7 with identifier: YA31821 to the API
2026-03-28 08:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:05Z',
 'fuel_type': 'diesel',
 'id': '290ecde7-a34b-56b5-8be0-3b2fb792b0e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA31821',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 105876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-07',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA31821%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Saving data for YA31821: {'auction_closing_time': 1774716185.0, 'created_time': 1774471374.782704, 'last_price_update_time': 1774686998.149044}
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA31821') HTTP/1.1" 204 0
2026-03-28 08:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS83423%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for MS83423: 2
2026-03-28 08:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f13c4c-1234-56c7-8d49-3d09d0ac8135 with identifier: MS83423
2026-03-28 08:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f13c4c-1234-56c7-8d49-3d09d0ac8135 with scrape type 2
2026-03-28 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f13c4c-1234-56c7-8d49-3d09d0ac8135 with scrape type 2
2026-03-28 08:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24f13c4c-1234-56c7-8d49-3d09d0ac8135, identifier: MS83423
2026-03-28 08:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24f13c4c-1234-56c7-8d49-3d09d0ac8135 with identifier: MS83423
2026-03-28 08:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24f13c4c-1234-56c7-8d49-3d09d0ac8135 with identifier: MS83423
2026-03-28 08:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24f13c4c-1234-56c7-8d49-3d09d0ac8135 with identifier: MS83423 to the API
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:24Z',
 'fuel_type': 'petrol',
 'id': '24f13c4c-1234-56c7-8d49-3d09d0ac8135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS83423',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 31404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS83423%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Saving data for MS83423: {'auction_closing_time': 1774715124.0, 'created_time': 1774471133.407815, 'last_price_update_time': 1774686998.661194}
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS83423') HTTP/1.1" 204 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ35563%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for RJ35563: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for NJ53644: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW54495%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for KW54495: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW19960%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for EW19960: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL30706%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for VL30706: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44813%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for DT44813: 0
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 08:36:38 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS77634%27 HTTP/1.1" 200 None
2026-03-28 08:36:38 [auto1.be] INFO: Scrape type for GS77634: 2
2026-03-28 08:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a707706d-d4b5-5375-bf9c-56f9a090ce43 with identifier: GS77634
2026-03-28 08:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a707706d-d4b5-5375-bf9c-56f9a090ce43 with scrape type 2
2026-03-28 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a707706d-d4b5-5375-bf9c-56f9a090ce43 with scrape type 2
2026-03-28 08:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a707706d-d4b5-5375-bf9c-56f9a090ce43, identifier: GS77634
2026-03-28 08:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a707706d-d4b5-5375-bf9c-56f9a090ce43 with identifier: GS77634
2026-03-28 08:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 08:36:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a707706d-d4b5-5375-bf9c-56f9a090ce43 with identifier: GS77634
2026-03-28 08:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a707706d-d4b5-5375-bf9c-56f9a090ce43 with identifier: GS77634 to the API
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:54:04Z',
 'fuel_type': 'diesel',
 'id': 'a707706d-d4b5-5375-bf9c-56f9a090ce43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS77634',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 111367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-08',
 'seller_name': None,
 'title': 'Kia Venga 1.4 CRDi Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2012}
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS77634%27 HTTP/1.1" 200 None
2026-03-28 08:36:39 [auto1.be] INFO: Saving data for GS77634: {'auction_closing_time': 1774716844.0, 'created_time': 1774471405.536802, 'last_price_update_time': 1774686999.382822}
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS77634') HTTP/1.1" 204 0
2026-03-28 08:36:39 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH29158%27 HTTP/1.1" 200 None
2026-03-28 08:36:39 [auto1.be] INFO: Scrape type for NH29158: 2
2026-03-28 08:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ce4457-263c-507e-b191-d4a9362517c5 with identifier: NH29158
2026-03-28 08:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ce4457-263c-507e-b191-d4a9362517c5 with scrape type 2
2026-03-28 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ce4457-263c-507e-b191-d4a9362517c5 with scrape type 2
2026-03-28 08:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64ce4457-263c-507e-b191-d4a9362517c5, identifier: NH29158
2026-03-28 08:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64ce4457-263c-507e-b191-d4a9362517c5 with identifier: NH29158
2026-03-28 08:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64ce4457-263c-507e-b191-d4a9362517c5 with identifier: NH29158
2026-03-28 08:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64ce4457-263c-507e-b191-d4a9362517c5 with identifier: NH29158 to the API
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:25:41Z',
 'fuel_type': 'diesel',
 'id': '64ce4457-263c-507e-b191-d4a9362517c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH29158',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 129859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Business 2WD',
 'transmission': 'automatic',
 'trim': 'Business 2WD',
 'year': 2021}
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH29158%27 HTTP/1.1" 200 None
2026-03-28 08:36:39 [auto1.be] INFO: Saving data for NH29158: {'auction_closing_time': 1774715141.0, 'created_time': 1774471396.11724, 'last_price_update_time': 1774686999.880299}
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH29158') HTTP/1.1" 204 0
2026-03-28 08:36:39 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY53822%27 HTTP/1.1" 200 None
2026-03-28 08:36:39 [auto1.be] INFO: Scrape type for DY53822: 2
2026-03-28 08:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a60d0d6-99c9-539e-b0fe-184f17538ec9 with identifier: DY53822
2026-03-28 08:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a60d0d6-99c9-539e-b0fe-184f17538ec9 with scrape type 2
2026-03-28 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a60d0d6-99c9-539e-b0fe-184f17538ec9 with scrape type 2
2026-03-28 08:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a60d0d6-99c9-539e-b0fe-184f17538ec9, identifier: DY53822
2026-03-28 08:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a60d0d6-99c9-539e-b0fe-184f17538ec9 with identifier: DY53822
2026-03-28 08:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a60d0d6-99c9-539e-b0fe-184f17538ec9 with identifier: DY53822
2026-03-28 08:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a60d0d6-99c9-539e-b0fe-184f17538ec9 with identifier: DY53822 to the API
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:56:22Z',
 'fuel_type': 'diesel',
 'id': '7a60d0d6-99c9-539e-b0fe-184f17538ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY53822',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 171704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-25',
 'seller_name': None,
 'title': 'Audi Q7 45 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY53822%27 HTTP/1.1" 200 None
2026-03-28 08:36:40 [auto1.be] INFO: Saving data for DY53822: {'auction_closing_time': 1774716982.0, 'created_time': 1773301703.568544, 'last_price_update_time': 1774687000.296143}
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY53822') HTTP/1.1" 204 0
2026-03-28 08:36:40 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-28 08:36:40 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-28 08:36:40 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-28 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:41 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA35148%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for RA35148: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for GF59002: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB43323%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for EB43323: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for PV35906: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for SR71847: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: US70780
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH06099%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for JH06099: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ27954%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for WJ27954: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR58381%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for TR58381: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM08929%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for WM08929: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for YN20871: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for HS04385: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for FV41606: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN50786%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for YN50786: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM09652%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for CM09652: 0
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 08:36:41 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-28 08:36:41 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-28 08:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:42 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:42 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-28 08:36:42 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-28 08:36:42 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-28 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL97420%27 HTTP/1.1" 200 None
2026-03-28 08:36:42 [auto1.be] INFO: Scrape type for TL97420: 2
2026-03-28 08:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f020cd8-c1f0-58a6-9477-7854d23134df with identifier: TL97420
2026-03-28 08:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f020cd8-c1f0-58a6-9477-7854d23134df with scrape type 2
2026-03-28 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f020cd8-c1f0-58a6-9477-7854d23134df with scrape type 2
2026-03-28 08:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f020cd8-c1f0-58a6-9477-7854d23134df, identifier: TL97420
2026-03-28 08:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f020cd8-c1f0-58a6-9477-7854d23134df with identifier: TL97420
2026-03-28 08:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 08:36:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f020cd8-c1f0-58a6-9477-7854d23134df with identifier: TL97420
2026-03-28 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f020cd8-c1f0-58a6-9477-7854d23134df with identifier: TL97420 to the API
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:33Z',
 'fuel_type': 'petrol',
 'id': '1f020cd8-c1f0-58a6-9477-7854d23134df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL97420',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 109247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-27',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL97420%27 HTTP/1.1" 200 None
2026-03-28 08:36:43 [auto1.be] INFO: Saving data for TL97420: {'auction_closing_time': 1774715013.0, 'created_time': 1774471409.423086, 'last_price_update_time': 1774687003.38788}
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL97420') HTTP/1.1" 204 0
2026-03-28 08:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05336%27 HTTP/1.1" 200 None
2026-03-28 08:36:43 [auto1.be] INFO: Scrape type for GS05336: 0
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU70188%27 HTTP/1.1" 200 None
2026-03-28 08:36:43 [auto1.be] INFO: Scrape type for JU70188: 0
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-28 08:36:43 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-28 08:36:43 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK84429%27 HTTP/1.1" 200 None
2026-03-28 08:36:43 [auto1.be] INFO: Scrape type for RK84429: 2
2026-03-28 08:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 062ca47a-fe0e-551d-a15b-9e9930fe8c44 with identifier: RK84429
2026-03-28 08:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062ca47a-fe0e-551d-a15b-9e9930fe8c44 with scrape type 2
2026-03-28 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 062ca47a-fe0e-551d-a15b-9e9930fe8c44 with scrape type 2
2026-03-28 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 062ca47a-fe0e-551d-a15b-9e9930fe8c44, identifier: RK84429
2026-03-28 08:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 062ca47a-fe0e-551d-a15b-9e9930fe8c44 with identifier: RK84429
2026-03-28 08:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 062ca47a-fe0e-551d-a15b-9e9930fe8c44 with identifier: RK84429
2026-03-28 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 062ca47a-fe0e-551d-a15b-9e9930fe8c44 with identifier: RK84429 to the API
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:44Z',
 'fuel_type': 'petrol',
 'id': '062ca47a-fe0e-551d-a15b-9e9930fe8c44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK84429',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 103553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK84429%27 HTTP/1.1" 200 None
2026-03-28 08:36:43 [auto1.be] INFO: Saving data for RK84429: {'auction_closing_time': 1774716584.0, 'created_time': 1774471412.566753, 'last_price_update_time': 1774687003.934238}
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK84429') HTTP/1.1" 204 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK31159%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for DK31159: 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for MU76581: 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-28 08:36:44 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-28 08:36:44 [auto1.be] INFO: Scrape type for EJ45818: 0
2026-03-28 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:45 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX63908%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for WX63908: 2
2026-03-28 08:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba924615-12b7-5320-8214-762e1ae93d73 with identifier: WX63908
2026-03-28 08:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba924615-12b7-5320-8214-762e1ae93d73 with scrape type 2
2026-03-28 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba924615-12b7-5320-8214-762e1ae93d73 with scrape type 2
2026-03-28 08:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba924615-12b7-5320-8214-762e1ae93d73, identifier: WX63908
2026-03-28 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba924615-12b7-5320-8214-762e1ae93d73 with identifier: WX63908
2026-03-28 08:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba924615-12b7-5320-8214-762e1ae93d73 with identifier: WX63908
2026-03-28 08:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba924615-12b7-5320-8214-762e1ae93d73 with identifier: WX63908 to the API
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:53:58Z',
 'fuel_type': 'diesel',
 'id': 'ba924615-12b7-5320-8214-762e1ae93d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX63908',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 203786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-14',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Zenith',
 'transmission': 'manual',
 'trim': 'Zenith',
 'year': 2010}
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX63908%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Saving data for WX63908: {'auction_closing_time': 1774716838.0, 'created_time': 1774471352.773123, 'last_price_update_time': 1774687005.701053}
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WX63908') HTTP/1.1" 204 0
2026-03-28 08:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for RL53364: 0
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM52966%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for SM52966: 0
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for FR59063: 0
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ82774%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for BZ82774: 0
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-28 08:36:45 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS18318%27 HTTP/1.1" 200 None
2026-03-28 08:36:45 [auto1.be] INFO: Scrape type for KS18318: 2
2026-03-28 08:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1aaef8a-7079-57d6-9848-3fc863d3ed3e with identifier: KS18318
2026-03-28 08:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1aaef8a-7079-57d6-9848-3fc863d3ed3e with scrape type 2
2026-03-28 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1aaef8a-7079-57d6-9848-3fc863d3ed3e with scrape type 2
2026-03-28 08:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1aaef8a-7079-57d6-9848-3fc863d3ed3e, identifier: KS18318
2026-03-28 08:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1aaef8a-7079-57d6-9848-3fc863d3ed3e with identifier: KS18318
2026-03-28 08:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1aaef8a-7079-57d6-9848-3fc863d3ed3e with identifier: KS18318
2026-03-28 08:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1aaef8a-7079-57d6-9848-3fc863d3ed3e with identifier: KS18318 to the API
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:57:40Z',
 'fuel_type': 'petrol',
 'id': 'f1aaef8a-7079-57d6-9848-3fc863d3ed3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS18318',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 127365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-23',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2004}
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS18318%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Saving data for KS18318: {'auction_closing_time': 1774717060.0, 'created_time': 1774471378.451192, 'last_price_update_time': 1774687006.346968}
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS18318') HTTP/1.1" 204 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW21160%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for MW21160: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK67306%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for FK67306: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE17510%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for KE17510: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-28 08:36:46 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 08:36:46 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-28 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:47 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-28 08:36:47 [auto1.be] INFO: Scrape type for HJ27727: 0
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP97194%27 HTTP/1.1" 200 None
2026-03-28 08:36:47 [auto1.be] INFO: Scrape type for AP97194: 0
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-28 08:36:47 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP87063%27 HTTP/1.1" 200 None
2026-03-28 08:36:47 [auto1.be] INFO: Scrape type for TP87063: 2
2026-03-28 08:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586e09ff-cd45-5921-8aa6-9cbb40dad452 with identifier: TP87063
2026-03-28 08:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586e09ff-cd45-5921-8aa6-9cbb40dad452 with scrape type 2
2026-03-28 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 586e09ff-cd45-5921-8aa6-9cbb40dad452 with scrape type 2
2026-03-28 08:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 586e09ff-cd45-5921-8aa6-9cbb40dad452, identifier: TP87063
2026-03-28 08:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 586e09ff-cd45-5921-8aa6-9cbb40dad452 with identifier: TP87063
2026-03-28 08:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 586e09ff-cd45-5921-8aa6-9cbb40dad452 with identifier: TP87063
2026-03-28 08:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 586e09ff-cd45-5921-8aa6-9cbb40dad452 with identifier: TP87063 to the API
2026-03-28 08:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:50:12Z',
 'fuel_type': 'petrol',
 'id': '586e09ff-cd45-5921-8aa6-9cbb40dad452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP87063',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 162133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Volvo V40 1.5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2017}
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP87063%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Saving data for TP87063: {'auction_closing_time': 1774716612.0, 'created_time': 1774471350.703341, 'last_price_update_time': 1774687008.142853}
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP87063') HTTP/1.1" 204 0
2026-03-28 08:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for TX99790: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL40552%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for JL40552: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB89489%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for AB89489: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF35218%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for AF35218: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25655%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for WG25655: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT74022%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for XT74022: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for XE18058: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR44079%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for BR44079: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN27020%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for KN27020: 2
2026-03-28 08:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27 with identifier: KN27020
2026-03-28 08:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27 with scrape type 2
2026-03-28 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27 with scrape type 2
2026-03-28 08:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27, identifier: KN27020
2026-03-28 08:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27 with identifier: KN27020
2026-03-28 08:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27 with identifier: KN27020
2026-03-28 08:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44d9b1b4-fbe7-5dba-af61-a9bfc951aa27 with identifier: KN27020 to the API
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:37Z',
 'fuel_type': 'petrol',
 'id': '44d9b1b4-fbe7-5dba-af61-a9bfc951aa27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN27020',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 188255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN27020%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Saving data for KN27020: {'auction_closing_time': 1774714957.0, 'created_time': 1774471382.764798, 'last_price_update_time': 1774687008.869909}
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KN27020') HTTP/1.1" 204 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC35394%27 HTTP/1.1" 200 None
2026-03-28 08:36:48 [auto1.be] INFO: Scrape type for AC35394: 0
2026-03-28 08:36:48 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 08:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:49 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:49 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-28 08:36:49 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-28 08:36:49 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-28 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-28 08:36:49 [auto1.be] INFO: Scrape type for JX10335: 0
2026-03-28 08:36:49 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM70865%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for HM70865: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR60731%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for RR60731: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for VW71513: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR16317%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for MR16317: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP38880%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for CP38880: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW93174%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for VW93174: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for SJ72272: 2
2026-03-28 08:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272
2026-03-28 08:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e85e86-c756-5403-a2d2-17bc69edb9cc with scrape type 2
2026-03-28 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e85e86-c756-5403-a2d2-17bc69edb9cc with scrape type 2
2026-03-28 08:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 60e85e86-c756-5403-a2d2-17bc69edb9cc, identifier: SJ72272
2026-03-28 08:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272
2026-03-28 08:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272
2026-03-28 08:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272 to the API
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:16:53Z',
 'fuel_type': 'petrol',
 'id': '60e85e86-c756-5403-a2d2-17bc69edb9cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ72272',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 101074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Saving data for SJ72272: {'auction_closing_time': 1774714613.0, 'created_time': 1774471393.31772, 'last_price_update_time': 1774687010.587464}
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ72272') HTTP/1.1" 204 0
2026-03-28 08:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB89914%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for ZB89914: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for ZC75548: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB02189%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for CB02189: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ85398%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for FJ85398: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC39555%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for PC39555: 0
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-28 08:36:50 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-28 08:36:50 [auto1.be] INFO: Scrape type for GN71373: 2
2026-03-28 08:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373
2026-03-28 08:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a5d323-89a5-50f8-a71d-570999b5d22b with scrape type 2
2026-03-28 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21a5d323-89a5-50f8-a71d-570999b5d22b with scrape type 2
2026-03-28 08:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21a5d323-89a5-50f8-a71d-570999b5d22b, identifier: GN71373
2026-03-28 08:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373
2026-03-28 08:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373
2026-03-28 08:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373 to the API
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:43Z',
 'fuel_type': 'petrol',
 'id': '21a5d323-89a5-50f8-a71d-570999b5d22b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN71373',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 257351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-11',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-28 08:36:51 [auto1.be] INFO: Saving data for GN71373: {'auction_closing_time': 1774713883.0, 'created_time': 1774471175.934794, 'last_price_update_time': 1774687011.244854}
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN71373') HTTP/1.1" 204 0
2026-03-28 08:36:51 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-28 08:36:51 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-28 08:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:52 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN84271%27 HTTP/1.1" 200 None
2026-03-28 08:36:52 [auto1.be] INFO: Scrape type for XN84271: 0
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-28 08:36:52 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-28 08:36:52 [auto1.be] INFO: Scrape type for HW03040: 0
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-28 08:36:52 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH93162%27 HTTP/1.1" 200 None
2026-03-28 08:36:52 [auto1.be] INFO: Scrape type for YH93162: 0
2026-03-28 08:36:52 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB63888%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for FB63888: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE27589%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for HE27589: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA95611%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for MA95611: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC02969%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for TC02969: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN67239%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for YN67239: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW46644%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for RW46644: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-28 08:36:53 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 08:36:53 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-28 08:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:54 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS55716%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for HS55716: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for MJ01257: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB82847%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for UB82847: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR21590%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for HR21590: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE31569%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for NE31569: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF25932%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for TF25932: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD17756%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for BD17756: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for WT96819: 0
2026-03-28 08:36:54 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE05105%27 HTTP/1.1" 200 None
2026-03-28 08:36:54 [auto1.be] INFO: Scrape type for GE05105: 2
2026-03-28 08:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b447c32-ac80-55ad-a286-48c560f356ba with identifier: GE05105
2026-03-28 08:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b447c32-ac80-55ad-a286-48c560f356ba with scrape type 2
2026-03-28 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b447c32-ac80-55ad-a286-48c560f356ba with scrape type 2
2026-03-28 08:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b447c32-ac80-55ad-a286-48c560f356ba, identifier: GE05105
2026-03-28 08:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b447c32-ac80-55ad-a286-48c560f356ba with identifier: GE05105
2026-03-28 08:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b447c32-ac80-55ad-a286-48c560f356ba with identifier: GE05105
2026-03-28 08:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b447c32-ac80-55ad-a286-48c560f356ba with identifier: GE05105 to the API
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:13:55Z',
 'fuel_type': 'petrol',
 'id': '6b447c32-ac80-55ad-a286-48c560f356ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE05105',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 99113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE05105%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Saving data for GE05105: {'auction_closing_time': 1774714435.0, 'created_time': 1774471392.231529, 'last_price_update_time': 1774687015.083081}
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GE05105') HTTP/1.1" 204 0
2026-03-28 08:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM85548%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for XM85548: 2
2026-03-28 08:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc90abd9-5576-59d1-86f0-c5c47ea7851b with identifier: XM85548
2026-03-28 08:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc90abd9-5576-59d1-86f0-c5c47ea7851b with scrape type 2
2026-03-28 08:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc90abd9-5576-59d1-86f0-c5c47ea7851b with scrape type 2
2026-03-28 08:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cc90abd9-5576-59d1-86f0-c5c47ea7851b, identifier: XM85548
2026-03-28 08:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cc90abd9-5576-59d1-86f0-c5c47ea7851b with identifier: XM85548
2026-03-28 08:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cc90abd9-5576-59d1-86f0-c5c47ea7851b with identifier: XM85548
2026-03-28 08:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cc90abd9-5576-59d1-86f0-c5c47ea7851b with identifier: XM85548 to the API
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:58Z',
 'fuel_type': 'petrol',
 'id': 'cc90abd9-5576-59d1-86f0-c5c47ea7851b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM85548',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 93009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-12',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM85548%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Saving data for XM85548: {'auction_closing_time': 1774716778.0, 'created_time': 1774471096.080504, 'last_price_update_time': 1774687015.570576}
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM85548') HTTP/1.1" 204 0
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH22912%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for LH22912: 0
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP73132%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for EP73132: 0
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for YN92139: 0
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK21410%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for YK21410: 0
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN48415%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for HN48415: 0
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-28 08:36:55 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX75796%27 HTTP/1.1" 200 None
2026-03-28 08:36:55 [auto1.be] INFO: Scrape type for ZX75796: 0
2026-03-28 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:36:56 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1704 | hits on page: 40
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN00182%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for WN00182: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for RS16623: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF21497%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for HF21497: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK03982%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for CK03982: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15441%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for CH15441: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for HM28534: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN58260%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for YN58260: 0
2026-03-28 08:36:56 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC53588%27 HTTP/1.1" 200 None
2026-03-28 08:36:56 [auto1.be] INFO: Scrape type for ZC53588: 2
2026-03-28 08:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74fea809-9fc0-5260-bd32-817d4469f1b8 with identifier: ZC53588
2026-03-28 08:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74fea809-9fc0-5260-bd32-817d4469f1b8 with scrape type 2
2026-03-28 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74fea809-9fc0-5260-bd32-817d4469f1b8 with scrape type 2
2026-03-28 08:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 74fea809-9fc0-5260-bd32-817d4469f1b8, identifier: ZC53588
2026-03-28 08:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 74fea809-9fc0-5260-bd32-817d4469f1b8 with identifier: ZC53588
2026-03-28 08:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 74fea809-9fc0-5260-bd32-817d4469f1b8 with identifier: ZC53588
2026-03-28 08:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 74fea809-9fc0-5260-bd32-817d4469f1b8 with identifier: ZC53588 to the API
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:46:23Z',
 'fuel_type': 'petrol',
 'id': '74fea809-9fc0-5260-bd32-817d4469f1b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC53588',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 84180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-19',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2013}
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC53588%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Saving data for ZC53588: {'auction_closing_time': 1774716383.0, 'created_time': 1774471320.441513, 'last_price_update_time': 1774687017.215205}
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC53588') HTTP/1.1" 204 0
2026-03-28 08:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG60858%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for WG60858: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA07784%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for PA07784: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL24574%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for JL24574: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB18331%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for GB18331: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE98600%27 HTTP/1.1" 200 None
2026-03-28 08:36:57 [auto1.be] INFO: Scrape type for GE98600: 0
2026-03-28 08:36:57 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-28 08:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:01 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM50519%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for UM50519: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for TS78695: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL98118%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for UL98118: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for AY48728: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for KW49487: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for JC58807: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA01247%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for PA01247: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV96305%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for NV96305: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN32726%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for PN32726: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK27252%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for VK27252: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL06267%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for ZL06267: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP77494%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for HP77494: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-28 08:37:01 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-28 08:37:01 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-28 08:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:03 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM10661%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for LM10661: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ73148%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for WJ73148: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB59400%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for UB59400: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for FV38279: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY06710%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for EY06710: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX67951%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for RX67951: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM98751%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for ZM98751: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU29895%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for YU29895: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC47788%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for PC47788: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ17204%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for XJ17204: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX95723%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for JX95723: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP70611%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for JP70611: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20411%27 HTTP/1.1" 200 None
2026-03-28 08:37:03 [auto1.be] INFO: Scrape type for BY20411: 0
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-28 08:37:03 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-28 08:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:04 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED46000%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for ED46000: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU65745%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for MU65745: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV66357%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for UV66357: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU96332%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for XU96332: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS41207%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for GS41207: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU53193%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for SU53193: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG72902%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for EG72902: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC45178%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for YC45178: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU26363%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for ZU26363: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ61910%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for ZJ61910: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH02429%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for PH02429: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK22486%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for RK22486: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP17871%27 HTTP/1.1" 200 None
2026-03-28 08:37:04 [auto1.be] INFO: Scrape type for SP17871: 0
2026-03-28 08:37:04 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 08:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:06 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for LJ62513: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK56681%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for PK56681: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW39031%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for BW39031: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF15536%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for BF15536: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC04988%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for PC04988: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY14348%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for HY14348: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU52750%27 HTTP/1.1" 200 None
2026-03-28 08:37:06 [auto1.be] INFO: Scrape type for UU52750: 0
2026-03-28 08:37:06 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-28 08:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:06 [scrapy.extensions.logstats] INFO: Crawled 72 pages (at 20 pages/min), scraped 98 items (at 44 items/min)
2026-03-28 08:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-28 08:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:10 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE95300%27 HTTP/1.1" 200 None
2026-03-28 08:37:10 [auto1.be] INFO: Scrape type for GE95300: 0
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN79579%27 HTTP/1.1" 200 None
2026-03-28 08:37:10 [auto1.be] INFO: Scrape type for XN79579: 0
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-28 08:37:10 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP34819%27 HTTP/1.1" 200 None
2026-03-28 08:37:10 [auto1.be] INFO: Scrape type for TP34819: 0
2026-03-28 08:37:10 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV25434%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for MV25434: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ13946%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for XZ13946: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC83971%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for JC83971: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ63338%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for VJ63338: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT11413%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for KT11413: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY09771%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for HY09771: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ75207%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for FJ75207: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL87249%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for EL87249: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 08:37:11 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS70966%27 HTTP/1.1" 200 None
2026-03-28 08:37:11 [auto1.be] INFO: Scrape type for VS70966: 0
2026-03-28 08:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:12 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR03762%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for LR03762: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH43502%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for HH43502: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE21828%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for CE21828: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR17508%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for JR17508: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for CK64923: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS34473%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for MS34473: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-28 08:37:12 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-28 08:37:12 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-28 08:37:13 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-28 08:37:13 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-28 08:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:14 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW24606%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for WW24606: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF96553%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for VF96553: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR55859%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for TR55859: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL68944%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for SL68944: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP59959%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for CP59959: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU40891%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for ZU40891: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM95515%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for PM95515: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-28 08:37:14 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-28 08:37:14 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 08:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:15 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA13965%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for MA13965: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL31605%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for XL31605: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-28 08:37:15 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-28 08:37:15 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM57328%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for AM57328: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV08195%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for FV08195: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for PW35881: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for ZG24921: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for GC38550: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for TH87974: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for XL16576: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-28 08:37:16 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-28 08:37:16 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 08:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:18 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-28 08:37:18 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-28 08:37:18 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST31185%27 HTTP/1.1" 200 None
2026-03-28 08:37:18 [auto1.be] INFO: Scrape type for ST31185: 0
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT92928%27 HTTP/1.1" 200 None
2026-03-28 08:37:18 [auto1.be] INFO: Scrape type for WT92928: 0
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-28 08:37:18 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 08:37:18 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT14549%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for VT14549: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG79733%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for WG79733: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB76910%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for GB76910: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF72066%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for WF72066: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR14818%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for RR14818: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for RC34183: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-28 08:37:19 [auto1.be] INFO: Scrape type for VZ41655: 0
2026-03-28 08:37:19 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-28 08:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:20 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for TY10971: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for DL37030: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for BU79691: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-28 08:37:20 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 08:37:20 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 08:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:21 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-28 08:37:21 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-28 08:37:21 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 08:37:21 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-28 08:37:22 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 08:37:22 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 08:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:24 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for HL14568: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for BW89679: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for KV58178: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN53703%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for UN53703: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-28 08:37:24 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-28 08:37:24 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 08:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:25 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for YJ60132: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ69250%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for FJ69250: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for CB60498: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-28 08:37:25 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-28 08:37:25 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-28 08:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:27 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for ZD51863: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for MD39375: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-28 08:37:27 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-28 08:37:27 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-28 08:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:28 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-28 08:37:28 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 08:37:28 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 08:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:30 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1704 | hits on page: 40
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-28 08:37:30 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-28 08:37:30 [auto1.be] INFO: Scrape type for NY53837: 0
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-28 08:37:30 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 08:37:30 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV40639%27 HTTP/1.1" 200 None
2026-03-28 08:37:30 [auto1.be] INFO: Scrape type for FV40639: 2
2026-03-28 08:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6386710d-0cd5-5b5e-bf00-af504750f9d7 with identifier: FV40639
2026-03-28 08:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6386710d-0cd5-5b5e-bf00-af504750f9d7 with scrape type 2
2026-03-28 08:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6386710d-0cd5-5b5e-bf00-af504750f9d7 with scrape type 2
2026-03-28 08:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6386710d-0cd5-5b5e-bf00-af504750f9d7, identifier: FV40639
2026-03-28 08:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6386710d-0cd5-5b5e-bf00-af504750f9d7 with identifier: FV40639
2026-03-28 08:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6386710d-0cd5-5b5e-bf00-af504750f9d7 with identifier: FV40639
2026-03-28 08:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6386710d-0cd5-5b5e-bf00-af504750f9d7 with identifier: FV40639 to the API
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:43:47Z',
 'fuel_type': 'diesel',
 'id': '6386710d-0cd5-5b5e-bf00-af504750f9d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV40639',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 145970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-13',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2017}
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV40639%27 HTTP/1.1" 200 None
2026-03-28 08:37:31 [auto1.be] INFO: Saving data for FV40639: {'auction_closing_time': 1774716227.0, 'created_time': 1774600540.319661, 'last_price_update_time': 1774687051.173621}
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV40639') HTTP/1.1" 204 0
2026-03-28 08:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:31 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 08:37:31 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 08:37:31 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-28 08:37:31 [auto1.be] INFO: Scrape type for CX83686: 2
2026-03-28 08:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-28 08:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb3ceb2-6234-5922-a477-19e3436c2264 with scrape type 2
2026-03-28 08:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb3ceb2-6234-5922-a477-19e3436c2264 with scrape type 2
2026-03-28 08:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bb3ceb2-6234-5922-a477-19e3436c2264, identifier: CX83686
2026-03-28 08:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-28 08:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-28 08:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686 to the API
2026-03-28 08:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:01:19Z',
 'fuel_type': 'hybrid',
 'id': '1bb3ceb2-6234-5922-a477-19e3436c2264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX83686',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 75365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-28 08:37:32 [auto1.be] INFO: Saving data for CX83686: {'auction_closing_time': 1774713679.0, 'created_time': 1773866727.396592, 'last_price_update_time': 1774687052.547404}
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX83686') HTTP/1.1" 204 0
2026-03-28 08:37:32 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU84298%27 HTTP/1.1" 200 None
2026-03-28 08:37:32 [auto1.be] INFO: Scrape type for JU84298: 2
2026-03-28 08:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebeb094d-ae39-5d88-a37c-43efbf920fef with identifier: JU84298
2026-03-28 08:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebeb094d-ae39-5d88-a37c-43efbf920fef with scrape type 2
2026-03-28 08:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebeb094d-ae39-5d88-a37c-43efbf920fef with scrape type 2
2026-03-28 08:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebeb094d-ae39-5d88-a37c-43efbf920fef, identifier: JU84298
2026-03-28 08:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebeb094d-ae39-5d88-a37c-43efbf920fef with identifier: JU84298
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 08:37:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebeb094d-ae39-5d88-a37c-43efbf920fef with identifier: JU84298
2026-03-28 08:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebeb094d-ae39-5d88-a37c-43efbf920fef with identifier: JU84298 to the API
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:12:36Z',
 'fuel_type': 'diesel',
 'id': 'ebeb094d-ae39-5d88-a37c-43efbf920fef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU84298',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 162940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU84298%27 HTTP/1.1" 200 None
2026-03-28 08:37:33 [auto1.be] INFO: Saving data for JU84298: {'auction_closing_time': 1774714356.0, 'created_time': 1774600537.302751, 'last_price_update_time': 1774687053.086824}
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU84298') HTTP/1.1" 204 0
2026-03-28 08:37:33 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 08:37:33 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-28 08:37:33 [auto1.be] INFO: Scrape type for WP32655: 2
2026-03-28 08:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-28 08:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e8f1a5-06f7-5510-bb0c-82171044cc06 with scrape type 2
2026-03-28 08:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43e8f1a5-06f7-5510-bb0c-82171044cc06 with scrape type 2
2026-03-28 08:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43e8f1a5-06f7-5510-bb0c-82171044cc06, identifier: WP32655
2026-03-28 08:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-28 08:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-28 08:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655 to the API
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:47:03Z',
 'fuel_type': 'diesel',
 'id': '43e8f1a5-06f7-5510-bb0c-82171044cc06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP32655',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 57693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-19',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2014}
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-28 08:37:33 [auto1.be] INFO: Saving data for WP32655: {'auction_closing_time': 1774716423.0, 'created_time': 1774600540.963012, 'last_price_update_time': 1774687053.460307}
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP32655') HTTP/1.1" 204 0
2026-03-28 08:37:33 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 08:37:33 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-28 08:37:33 [auto1.be] INFO: Scrape type for FY33898: 2
2026-03-28 08:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-28 08:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with scrape type 2
2026-03-28 08:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with scrape type 2
2026-03-28 08:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10, identifier: FY33898
2026-03-28 08:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-28 08:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-28 08:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898 to the API
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:43:42Z',
 'fuel_type': 'petrol',
 'id': '0176d99f-9376-5e1c-ab01-6f3e5fd48f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY33898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 291418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-17',
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2012}
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-28 08:37:33 [auto1.be] INFO: Saving data for FY33898: {'auction_closing_time': 1774716222.0, 'created_time': 1773434461.814355, 'last_price_update_time': 1774687053.847513}
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY33898') HTTP/1.1" 204 0
2026-03-28 08:37:33 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-28 08:37:33 [auto1.be] INFO: Scrape type for EG14798: 2
2026-03-28 08:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-28 08:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e822f5b3-2786-56fc-90e7-1311ff739363 with scrape type 2
2026-03-28 08:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e822f5b3-2786-56fc-90e7-1311ff739363 with scrape type 2
2026-03-28 08:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e822f5b3-2786-56fc-90e7-1311ff739363, identifier: EG14798
2026-03-28 08:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-28 08:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-28 08:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798 to the API
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:36:06Z',
 'fuel_type': 'petrol',
 'id': 'e822f5b3-2786-56fc-90e7-1311ff739363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG14798',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 137200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-28 08:37:34 [auto1.be] INFO: Saving data for EG14798: {'auction_closing_time': 1774715766.0, 'created_time': 1773909356.78368, 'last_price_update_time': 1774687054.223223}
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG14798') HTTP/1.1" 204 0
2026-03-28 08:37:34 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-28 08:37:34 [auto1.be] INFO: Scrape type for NZ84501: 2
2026-03-28 08:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-28 08:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53177884-ab4c-50a6-853e-6e5964d8bc27 with scrape type 2
2026-03-28 08:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53177884-ab4c-50a6-853e-6e5964d8bc27 with scrape type 2
2026-03-28 08:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53177884-ab4c-50a6-853e-6e5964d8bc27, identifier: NZ84501
2026-03-28 08:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-28 08:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-28 08:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501 to the API
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:01Z',
 'fuel_type': 'petrol',
 'id': '53177884-ab4c-50a6-853e-6e5964d8bc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ84501',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 107943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-29',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Custom',
 'transmission': 'automatic',
 'trim': 'Custom',
 'year': 2016}
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-28 08:37:34 [auto1.be] INFO: Saving data for NZ84501: {'auction_closing_time': 1774714201.0, 'created_time': 1774600542.14891, 'last_price_update_time': 1774687054.598634}
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ84501') HTTP/1.1" 204 0
2026-03-28 08:37:34 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-28 08:37:34 [auto1.be] INFO: Scrape type for RA68631: 2
2026-03-28 08:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-28 08:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1708629c-498c-58cd-8397-84b9e29651f3 with scrape type 2
2026-03-28 08:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1708629c-498c-58cd-8397-84b9e29651f3 with scrape type 2
2026-03-28 08:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1708629c-498c-58cd-8397-84b9e29651f3, identifier: RA68631
2026-03-28 08:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-28 08:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-28 08:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631 to the API
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:02Z',
 'fuel_type': 'diesel',
 'id': '1708629c-498c-58cd-8397-84b9e29651f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA68631',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 228568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2017}
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-28 08:37:34 [auto1.be] INFO: Saving data for RA68631: {'auction_closing_time': 1774716062.0, 'created_time': 1774600542.551652, 'last_price_update_time': 1774687054.989237}
2026-03-28 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA68631') HTTP/1.1" 204 0
2026-03-28 08:37:35 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 08:37:35 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-28 08:37:35 [auto1.be] INFO: Scrape type for BC23353: 2
2026-03-28 08:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45af58a2-7073-5238-9ed1-4c2a05ecadd2 with identifier: BC23353
2026-03-28 08:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45af58a2-7073-5238-9ed1-4c2a05ecadd2 with scrape type 2
2026-03-28 08:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45af58a2-7073-5238-9ed1-4c2a05ecadd2 with scrape type 2
2026-03-28 08:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45af58a2-7073-5238-9ed1-4c2a05ecadd2, identifier: BC23353
2026-03-28 08:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45af58a2-7073-5238-9ed1-4c2a05ecadd2 with identifier: BC23353
2026-03-28 08:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45af58a2-7073-5238-9ed1-4c2a05ecadd2 with identifier: BC23353
2026-03-28 08:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45af58a2-7073-5238-9ed1-4c2a05ecadd2 with identifier: BC23353 to the API
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:25:34Z',
 'fuel_type': 'diesel',
 'id': '45af58a2-7073-5238-9ed1-4c2a05ecadd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC23353',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 81254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-03',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2H1 29 Kasten',
 'transmission': 'manual',
 'trim': 'L2H1 29 Kasten',
 'year': 2016}
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-28 08:37:35 [auto1.be] INFO: Saving data for BC23353: {'auction_closing_time': 1774715134.0, 'created_time': 1774600534.591849, 'last_price_update_time': 1774687055.454519}
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC23353') HTTP/1.1" 204 0
2026-03-28 08:37:35 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-28 08:37:35 [auto1.be] INFO: Scrape type for BJ55526: 2
2026-03-28 08:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-28 08:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with scrape type 2
2026-03-28 08:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with scrape type 2
2026-03-28 08:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4412c6c3-53c2-56cf-9d30-c3800dda54e9, identifier: BJ55526
2026-03-28 08:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-28 08:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-28 08:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526 to the API
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:19:21Z',
 'fuel_type': 'petrol',
 'id': '4412c6c3-53c2-56cf-9d30-c3800dda54e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ55526',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 176548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Basis +',
 'transmission': 'manual',
 'trim': 'Basis +',
 'year': 2012}
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-28 08:37:35 [auto1.be] INFO: Saving data for BJ55526: {'auction_closing_time': 1774714761.0, 'created_time': 1774600525.857736, 'last_price_update_time': 1774687055.816395}
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ55526') HTTP/1.1" 204 0
2026-03-28 08:37:35 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-28 08:37:35 [auto1.be] INFO: Scrape type for JB98140: 2
2026-03-28 08:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-28 08:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with scrape type 2
2026-03-28 08:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with scrape type 2
2026-03-28 08:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb, identifier: JB98140
2026-03-28 08:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-28 08:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-28 08:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140 to the API
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:05Z',
 'fuel_type': 'diesel',
 'id': 'fd04258e-0d92-5c3d-8721-e65c6bd9d3bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB98140',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 318252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-23',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2013}
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-28 08:37:36 [auto1.be] INFO: Saving data for JB98140: {'auction_closing_time': 1774715285.0, 'created_time': 1774600539.62481, 'last_price_update_time': 1774687056.228934}
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB98140') HTTP/1.1" 204 0
2026-03-28 08:37:36 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1704 | hits on page: 24
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF18972%27 HTTP/1.1" 200 None
2026-03-28 08:37:36 [auto1.be] INFO: Scrape type for JF18972: 2
2026-03-28 08:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdade89b-54d1-5bb7-b9b4-fb717465a684 with identifier: JF18972
2026-03-28 08:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdade89b-54d1-5bb7-b9b4-fb717465a684 with scrape type 2
2026-03-28 08:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdade89b-54d1-5bb7-b9b4-fb717465a684 with scrape type 2
2026-03-28 08:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bdade89b-54d1-5bb7-b9b4-fb717465a684, identifier: JF18972
2026-03-28 08:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bdade89b-54d1-5bb7-b9b4-fb717465a684 with identifier: JF18972
2026-03-28 08:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bdade89b-54d1-5bb7-b9b4-fb717465a684 with identifier: JF18972
2026-03-28 08:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bdade89b-54d1-5bb7-b9b4-fb717465a684 with identifier: JF18972 to the API
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:35:44Z',
 'fuel_type': 'hybrid',
 'id': 'bdade89b-54d1-5bb7-b9b4-fb717465a684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF18972',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 98218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF18972%27 HTTP/1.1" 200 None
2026-03-28 08:37:36 [auto1.be] INFO: Saving data for JF18972: {'auction_closing_time': 1774715744.0, 'created_time': 1774600527.804843, 'last_price_update_time': 1774687056.619651}
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF18972') HTTP/1.1" 204 0
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-28 08:37:36 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA37935%27 HTTP/1.1" 200 None
2026-03-28 08:37:36 [auto1.be] INFO: Scrape type for YA37935: 2
2026-03-28 08:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19b623c-061b-5834-9ca5-0de57a69ac97 with identifier: YA37935
2026-03-28 08:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19b623c-061b-5834-9ca5-0de57a69ac97 with scrape type 2
2026-03-28 08:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19b623c-061b-5834-9ca5-0de57a69ac97 with scrape type 2
2026-03-28 08:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b19b623c-061b-5834-9ca5-0de57a69ac97, identifier: YA37935
2026-03-28 08:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b19b623c-061b-5834-9ca5-0de57a69ac97 with identifier: YA37935
2026-03-28 08:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b19b623c-061b-5834-9ca5-0de57a69ac97 with identifier: YA37935
2026-03-28 08:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b19b623c-061b-5834-9ca5-0de57a69ac97 with identifier: YA37935 to the API
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:21:45Z',
 'fuel_type': 'petrol',
 'id': 'b19b623c-061b-5834-9ca5-0de57a69ac97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA37935',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 118318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-09',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA37935%27 HTTP/1.1" 200 None
2026-03-28 08:37:37 [auto1.be] INFO: Saving data for YA37935: {'auction_closing_time': 1774714905.0, 'created_time': 1774600541.330859, 'last_price_update_time': 1774687057.100225}
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA37935') HTTP/1.1" 204 0
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-28 08:37:37 [auto1.be] INFO: Scrape type for SF89359: 2
2026-03-28 08:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-28 08:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90467edd-a787-5155-96c7-48be11c31ff2 with scrape type 2
2026-03-28 08:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90467edd-a787-5155-96c7-48be11c31ff2 with scrape type 2
2026-03-28 08:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90467edd-a787-5155-96c7-48be11c31ff2, identifier: SF89359
2026-03-28 08:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-28 08:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-28 08:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359 to the API
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:54Z',
 'fuel_type': 'petrol',
 'id': '90467edd-a787-5155-96c7-48be11c31ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF89359',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 80555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-28 08:37:37 [auto1.be] INFO: Saving data for SF89359: {'auction_closing_time': 1774715154.0, 'created_time': 1774600538.33691, 'last_price_update_time': 1774687057.515213}
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF89359') HTTP/1.1" 204 0
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ45584%27 HTTP/1.1" 200 None
2026-03-28 08:37:37 [auto1.be] INFO: Scrape type for JJ45584: 2
2026-03-28 08:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12173eae-5293-54c4-b0fa-d941b3089885 with identifier: JJ45584
2026-03-28 08:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12173eae-5293-54c4-b0fa-d941b3089885 with scrape type 2
2026-03-28 08:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12173eae-5293-54c4-b0fa-d941b3089885 with scrape type 2
2026-03-28 08:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12173eae-5293-54c4-b0fa-d941b3089885, identifier: JJ45584
2026-03-28 08:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12173eae-5293-54c4-b0fa-d941b3089885 with identifier: JJ45584
2026-03-28 08:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12173eae-5293-54c4-b0fa-d941b3089885 with identifier: JJ45584
2026-03-28 08:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12173eae-5293-54c4-b0fa-d941b3089885 with identifier: JJ45584 to the API
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:30Z',
 'fuel_type': 'petrol',
 'id': '12173eae-5293-54c4-b0fa-d941b3089885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ45584',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 98160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-18',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet S 4x2',
 'transmission': 'manual',
 'trim': 'S 4x2',
 'year': 2019}
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ45584%27 HTTP/1.1" 200 None
2026-03-28 08:37:37 [auto1.be] INFO: Saving data for JJ45584: {'auction_closing_time': 1774714470.0, 'created_time': 1774600535.77024, 'last_price_update_time': 1774687057.877877}
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ45584') HTTP/1.1" 204 0
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 08:37:37 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-28 08:37:37 [auto1.be] INFO: Scrape type for RR43173: 2
2026-03-28 08:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-28 08:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a93e4f-b357-532f-98e7-382c259ae859 with scrape type 2
2026-03-28 08:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a93e4f-b357-532f-98e7-382c259ae859 with scrape type 2
2026-03-28 08:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51a93e4f-b357-532f-98e7-382c259ae859, identifier: RR43173
2026-03-28 08:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-28 08:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-28 08:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173 to the API
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:54:00Z',
 'fuel_type': 'diesel',
 'id': '51a93e4f-b357-532f-98e7-382c259ae859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR43173',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 106717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-28 08:37:38 [auto1.be] INFO: Saving data for RR43173: {'auction_closing_time': 1774716840.0, 'created_time': 1774600548.054374, 'last_price_update_time': 1774687058.256904}
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR43173') HTTP/1.1" 204 0
2026-03-28 08:37:38 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 08:37:38 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 08:37:38 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-28 08:37:38 [auto1.be] INFO: Scrape type for VD09174: 2
2026-03-28 08:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-28 08:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with scrape type 2
2026-03-28 08:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with scrape type 2
2026-03-28 08:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee, identifier: VD09174
2026-03-28 08:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-28 08:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-28 08:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174 to the API
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'diesel',
 'id': 'c4308cbe-e410-57b1-8fd1-a7cfd3e170ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD09174',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 185116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-28 08:37:38 [auto1.be] INFO: Saving data for VD09174: {'auction_closing_time': 1774716224.0, 'created_time': 1773434380.758849, 'last_price_update_time': 1774687058.762863}
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VD09174') HTTP/1.1" 204 0
2026-03-28 08:37:38 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-28 08:37:38 [auto1.be] INFO: Scrape type for VA59143: 2
2026-03-28 08:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-28 08:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f2d533-e0ae-5885-9736-b45258329035 with scrape type 2
2026-03-28 08:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f2d533-e0ae-5885-9736-b45258329035 with scrape type 2
2026-03-28 08:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54f2d533-e0ae-5885-9736-b45258329035, identifier: VA59143
2026-03-28 08:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-28 08:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-28 08:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143 to the API
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:14:47Z',
 'fuel_type': 'diesel',
 'id': '54f2d533-e0ae-5885-9736-b45258329035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA59143',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 206974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.6 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-28 08:37:39 [auto1.be] INFO: Saving data for VA59143: {'auction_closing_time': 1774714487.0, 'created_time': 1773780033.301243, 'last_price_update_time': 1774687059.172048}
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA59143') HTTP/1.1" 204 0
2026-03-28 08:37:39 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-28 08:37:39 [auto1.be] INFO: Scrape type for MA69424: 2
2026-03-28 08:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-28 08:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with scrape type 2
2026-03-28 08:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with scrape type 2
2026-03-28 08:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812, identifier: MA69424
2026-03-28 08:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-28 08:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-28 08:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424 to the API
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:18Z',
 'fuel_type': 'diesel',
 'id': '55dc8aba-cf4d-5ca8-a65e-fa42572d3812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA69424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 144248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-28 08:37:39 [auto1.be] INFO: Saving data for MA69424: {'auction_closing_time': 1774715058.0, 'created_time': 1773132633.832627, 'last_price_update_time': 1774687059.637342}
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA69424') HTTP/1.1" 204 0
2026-03-28 08:37:39 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-28 08:37:39 [auto1.be] INFO: Scrape type for NP75657: 2
2026-03-28 08:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-28 08:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with scrape type 2
2026-03-28 08:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with scrape type 2
2026-03-28 08:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a, identifier: NP75657
2026-03-28 08:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-28 08:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-28 08:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657 to the API
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:33:58Z',
 'fuel_type': 'petrol',
 'id': '285d0ff0-8be5-5929-9cce-b8c00c37ef2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP75657',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 149094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-25',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-28 08:37:40 [auto1.be] INFO: Saving data for NP75657: {'auction_closing_time': 1774715638.0, 'created_time': 1774600543.772611, 'last_price_update_time': 1774687060.03537}
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP75657') HTTP/1.1" 204 0
2026-03-28 08:37:40 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-28 08:37:40 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-28 08:37:40 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-28 08:37:40 [auto1.be] INFO: Scrape type for NR94896: 2
2026-03-28 08:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-28 08:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446467ba-2c5c-5540-92d6-0f9df88e4d8f with scrape type 2
2026-03-28 08:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446467ba-2c5c-5540-92d6-0f9df88e4d8f with scrape type 2
2026-03-28 08:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 446467ba-2c5c-5540-92d6-0f9df88e4d8f, identifier: NR94896
2026-03-28 08:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-28 08:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-28 08:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896 to the API
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:56Z',
 'fuel_type': 'diesel',
 'id': '446467ba-2c5c-5540-92d6-0f9df88e4d8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR94896',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 136162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue 4x2 Titanium',
 'transmission': 'automatic',
 'trim': '4x2 Titanium',
 'year': 2020}
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-28 08:37:40 [auto1.be] INFO: Saving data for NR94896: {'auction_closing_time': 1774714676.0, 'created_time': 1774600544.249187, 'last_price_update_time': 1774687060.427751}
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NR94896') HTTP/1.1" 204 0
2026-03-28 08:37:40 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 08:37:40 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 08:37:40 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-28 08:37:40 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-28 08:37:40 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-28 08:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:37:42 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1704 | hits on page: 0
2026-03-28 08:37:42 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 08:37:42 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-28 08:37:42 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 5, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-28 08:37:42 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (119 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-28T08_35_00.jl
2026-03-28 08:37:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 376362,
 'downloader/request_count': 190,
 'downloader/request_method_count/GET': 144,
 'downloader/request_method_count/POST': 46,
 'downloader/response_bytes': 53934133,
 'downloader/response_count': 190,
 'downloader/response_status_count/200': 190,
 'dupefilter/filtered': 18,
 'elapsed_time_seconds': 155.951289,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 8, 37, 42, 588748, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 119,
 'log_count/DEBUG': 3624,
 'log_count/INFO': 4461,
 'memusage/max': 192569344,
 'memusage/startup': 149544960,
 'photo_download_count': 104,
 'request_depth_max': 47,
 'response_received_count': 86,
 'scheduler/dequeued': 190,
 'scheduler/dequeued/memory': 190,
 'scheduler/enqueued': 190,
 'scheduler/enqueued/memory': 190,
 'scrape_type/batch_skipped': 890,
 'scrape_type/new': 19,
 'scrape_type/price_update': 100,
 'scrape_type/skipped': 717,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 86,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.395591051550581,
 'scrapy-zyte-api/mean_response_seconds': 2.4697271829503484,
 'scrapy-zyte-api/processed': 86,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 86,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 85,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 86,
 'scrapy-zyte-api/request_args/httpRequestBody': 46,
 'scrapy-zyte-api/request_args/httpRequestMethod': 46,
 'scrapy-zyte-api/request_args/httpResponseBody': 86,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 86,
 'scrapy-zyte-api/request_args/sessionContext': 86,
 'scrapy-zyte-api/request_args/url': 86,
 'scrapy-zyte-api/status_codes/200': 86,
 'scrapy-zyte-api/success': 86,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1744,
 'source/total_available': 1704,
 'start_time': datetime.datetime(2026, 3, 28, 8, 35, 6, 637459, tzinfo=datetime.timezone.utc)}
2026-03-28 08:37:42 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 08:37:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb3bd01da10>
2026-03-28 08:37:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb3bcff4110>