2026-03-29 20:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 20:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 20:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-29 20:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 20:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 20:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 20:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 20:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 20:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 568658d892a77888
2026-03-29 20:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 20:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-29T20_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 20:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 20:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 20:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 20:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-29 20:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 20:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 20:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 20:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 20:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 20:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 20:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 20:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 20:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 20:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 20:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 20:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 20:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for RJ95996: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for LU32507: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for FT44143: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for VR58028: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for ES45973: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for MB50362: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for AD75254: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for JZ74663: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for JW28444: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for ST41989: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for SB58546: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for ZN33988: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for WV98137: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for WM98444: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for NE45749: 0
2026-03-29 20:30:16 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-29 20:30:16 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-29 20:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:18 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for RJ95996: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for LU32507: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for FT44143: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for VR58028: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for ES45973: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for MB50362: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for AD75254: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for JZ74663: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for JW28444: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for ST41989: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for SB58546: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for ZN33988: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for WV98137: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for WM98444: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for NE45749: 0
2026-03-29 20:30:18 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-29 20:30:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:19 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for GB22067: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for XS85102: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for BJ49980: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for ZZ18378: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for GN69495: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for XD29708: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for SK35491: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for DE26055: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for ET26989: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for PF75414: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for WZ74297: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [auto1.be] INFO: Scrape type for KR32592: 0
2026-03-29 20:30:19 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [auto1.be] INFO: Scrape type for WU68692: 0
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [auto1.be] INFO: Scrape type for DX83468: 0
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [auto1.be] INFO: Scrape type for SD20873: 0
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [auto1.be] INFO: Scrape type for EN78807: 0
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [auto1.be] INFO: Scrape type for PC06950: 0
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-29 20:30:20 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-29 20:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:21 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for ZC87174: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for GZ17047: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for TN87621: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for DP17314: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for WT61211: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for RG41014: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for GA47341: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for NL54460: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for MM05603: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for MT15926: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for GB86339: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for PW41553: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for FF69776: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for YH64614: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for BT87712: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for NC51382: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for JU27695: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for XU40393: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for FH50113: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for VM31149: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [auto1.be] INFO: Scrape type for JC67757: 0
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-29 20:30:21 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-29 20:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:22 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for DY35896: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for VM01272: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for KL42374: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for EL71552: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for SK78967: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for TG30379: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for DB21184: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for EA40127: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for DF78239: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for BE62996: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for EL91929: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for LE91648: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for ZZ00486: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for YK14398: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for FC68971: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for TE49371: 0
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-29 20:30:22 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-29 20:30:22 [auto1.be] INFO: Scrape type for CC34063: 0
2026-03-29 20:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:24 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for UX89863: 0
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for AJ87899: 0
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for RL01911: 0
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for CE14127: 0
2026-03-29 20:30:24 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-29 20:30:24 [auto1.be] INFO: Scrape type for KA88762: 2
2026-03-29 20:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-29 20:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with scrape type 2
2026-03-29 20:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with scrape type 2
2026-03-29 20:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c, identifier: KA88762
2026-03-29 20:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 20:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 20:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762
2026-03-29 20:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12046f2e-38e9-5ef9-b288-dac9c52a5f5c with identifier: KA88762 to the API
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:43:50Z',
 'fuel_type': 'diesel',
 'id': '12046f2e-38e9-5ef9-b288-dac9c52a5f5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA88762',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 58126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club XL',
 'transmission': 'manual',
 'trim': 'Club XL',
 'year': 2023}
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Saving data for KA88762: {'auction_closing_time': 1774885430.0, 'created_time': 1774611086.160765, 'last_price_update_time': 1774816225.647209}
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KA88762') HTTP/1.1" 204 0
2026-03-29 20:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for NH43704: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for XM15621: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for FM14350: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for FY63763: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for SZ16034: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for FP25504: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for BX88810: 0
2026-03-29 20:30:25 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [auto1.be] INFO: Scrape type for EJ45470: 2
2026-03-29 20:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-29 20:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f698588d-2208-571b-89b2-8b3c37f75c1d with scrape type 2
2026-03-29 20:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f698588d-2208-571b-89b2-8b3c37f75c1d with scrape type 2
2026-03-29 20:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f698588d-2208-571b-89b2-8b3c37f75c1d, identifier: EJ45470
2026-03-29 20:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 20:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 20:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470
2026-03-29 20:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f698588d-2208-571b-89b2-8b3c37f75c1d with identifier: EJ45470 to the API
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:04:46Z',
 'fuel_type': 'petrol',
 'id': 'f698588d-2208-571b-89b2-8b3c37f75c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ45470',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 90880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1975-08-27',
 'seller_name': None,
 'title': 'Porsche 911 G-Modell 2.7 Coupe',
 'transmission': 'manual',
 'trim': '2.7 Coupe',
 'year': 1975}
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-29 20:30:26 [auto1.be] INFO: Saving data for EJ45470: {'auction_closing_time': 1774883086.0, 'created_time': 1773921077.804371, 'last_price_update_time': 1774816226.646812}
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ45470') HTTP/1.1" 204 0
2026-03-29 20:30:26 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 20:30:26 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-29 20:30:26 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-29 20:30:26 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-29 20:30:26 [auto1.be] INFO: Scrape type for PD85961: 0
2026-03-29 20:30:26 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 20:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:27 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:27 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 20:30:27 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 20:30:27 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-29 20:30:27 [auto1.be] INFO: Scrape type for KE26750: 2
2026-03-29 20:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-29 20:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with scrape type 2
2026-03-29 20:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with scrape type 2
2026-03-29 20:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad, identifier: KE26750
2026-03-29 20:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-29 20:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 20:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750
2026-03-29 20:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad with identifier: KE26750 to the API
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:41:38Z',
 'fuel_type': 'petrol',
 'id': '351f7ecb-8b62-5e3e-9dcf-e81cfdfa8dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE26750',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 36437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-05',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-29 20:30:28 [auto1.be] INFO: Saving data for KE26750: {'auction_closing_time': 1774885298.0, 'created_time': 1774611034.023467, 'last_price_update_time': 1774816228.421255}
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE26750') HTTP/1.1" 204 0
2026-03-29 20:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:28 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-29 20:30:28 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-29 20:30:28 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 20:30:28 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 20:30:28 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-29 20:30:28 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-29 20:30:28 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 20:30:28 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-29 20:30:28 [auto1.be] INFO: Scrape type for UX94260: 2
2026-03-29 20:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-29 20:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac25ec6-cc54-594b-abd2-706436b33277 with scrape type 2
2026-03-29 20:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bac25ec6-cc54-594b-abd2-706436b33277 with scrape type 2
2026-03-29 20:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bac25ec6-cc54-594b-abd2-706436b33277, identifier: UX94260
2026-03-29 20:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-29 20:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260
2026-03-29 20:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bac25ec6-cc54-594b-abd2-706436b33277 with identifier: UX94260 to the API
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:02:28Z',
 'fuel_type': 'petrol',
 'id': 'bac25ec6-cc54-594b-abd2-706436b33277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX94260',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 147506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2016}
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [auto1.be] INFO: Saving data for UX94260: {'auction_closing_time': 1774882948.0, 'created_time': 1774611067.378808, 'last_price_update_time': 1774816229.033347}
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX94260') HTTP/1.1" 204 0
2026-03-29 20:30:29 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 20:30:29 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [auto1.be] INFO: Scrape type for JS18374: 2
2026-03-29 20:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-29 20:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e with scrape type 2
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b538691-ff5a-59fd-bbdf-8e023a42c42e with scrape type 2
2026-03-29 20:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0b538691-ff5a-59fd-bbdf-8e023a42c42e, identifier: JS18374
2026-03-29 20:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-29 20:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374
2026-03-29 20:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0b538691-ff5a-59fd-bbdf-8e023a42c42e with identifier: JS18374 to the API
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:14:34Z',
 'fuel_type': 'petrol',
 'id': '0b538691-ff5a-59fd-bbdf-8e023a42c42e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS18374',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 71806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-02-17',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 1999}
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Saving data for JS18374: {'auction_closing_time': 1774883674.0, 'created_time': 1774611135.66766, 'last_price_update_time': 1774816230.360053}
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS18374') HTTP/1.1" 204 0
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Scrape type for TX45109: 0
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Scrape type for RP30975: 2
2026-03-29 20:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-29 20:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5618d539-8186-5418-95ae-d9583b7e2f7a with scrape type 2
2026-03-29 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5618d539-8186-5418-95ae-d9583b7e2f7a with scrape type 2
2026-03-29 20:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5618d539-8186-5418-95ae-d9583b7e2f7a, identifier: RP30975
2026-03-29 20:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-29 20:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975
2026-03-29 20:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5618d539-8186-5418-95ae-d9583b7e2f7a with identifier: RP30975 to the API
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:45Z',
 'fuel_type': 'diesel',
 'id': '5618d539-8186-5418-95ae-d9583b7e2f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP30975',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 180172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Saving data for RP30975: {'auction_closing_time': 1774886025.0, 'created_time': 1773301773.417088, 'last_price_update_time': 1774816230.846422}
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RP30975') HTTP/1.1" 204 0
2026-03-29 20:30:30 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-29 20:30:30 [auto1.be] INFO: Scrape type for TV92859: 2
2026-03-29 20:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859
2026-03-29 20:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with scrape type 2
2026-03-29 20:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with scrape type 2
2026-03-29 20:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0, identifier: TV92859
2026-03-29 20:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859
2026-03-29 20:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 20:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 20:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859
2026-03-29 20:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0 with identifier: TV92859 to the API
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:03:13Z',
 'fuel_type': 'hybrid',
 'id': '67d34c02-e7fe-5929-9d5c-3f4b95ea9bf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV92859',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 190539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2019}
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Saving data for TV92859: {'auction_closing_time': 1774882993.0, 'created_time': 1773233830.873199, 'last_price_update_time': 1774816231.755734}
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV92859') HTTP/1.1" 204 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 20:30:31 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-29 20:30:31 [auto1.be] INFO: Scrape type for BD10300: 2
2026-03-29 20:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-29 20:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3212e001-69af-5cee-80ea-05b81d630228 with scrape type 2
2026-03-29 20:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3212e001-69af-5cee-80ea-05b81d630228 with scrape type 2
2026-03-29 20:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3212e001-69af-5cee-80ea-05b81d630228, identifier: BD10300
2026-03-29 20:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-29 20:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300
2026-03-29 20:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3212e001-69af-5cee-80ea-05b81d630228 with identifier: BD10300 to the API
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:31:38Z',
 'fuel_type': 'hybrid',
 'id': '3212e001-69af-5cee-80ea-05b81d630228',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD10300',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 92502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Essential 2WD',
 'transmission': 'automatic',
 'trim': 'Essential 2WD',
 'year': 2021}
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Saving data for BD10300: {'auction_closing_time': 1774884698.0, 'created_time': 1774265429.947401, 'last_price_update_time': 1774816232.399652}
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD10300') HTTP/1.1" 204 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-29 20:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:32 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 20:30:32 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-29 20:30:32 [auto1.be] INFO: Scrape type for JS91211: 2
2026-03-29 20:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-29 20:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with scrape type 2
2026-03-29 20:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with scrape type 2
2026-03-29 20:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba, identifier: JS91211
2026-03-29 20:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-29 20:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211
2026-03-29 20:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12e4a183-5766-5ba6-bfec-b32bcb9a25ba with identifier: JS91211 to the API
2026-03-29 20:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:01Z',
 'fuel_type': 'diesel',
 'id': '12e4a183-5766-5ba6-bfec-b32bcb9a25ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS91211',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 141385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-16',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 e-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Saving data for JS91211: {'auction_closing_time': 1774885141.0, 'created_time': 1774611108.864183, 'last_price_update_time': 1774816234.737633}
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS91211') HTTP/1.1" 204 0
2026-03-29 20:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-29 20:30:34 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-29 20:30:34 [auto1.be] INFO: Scrape type for ND89972: 2
2026-03-29 20:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-29 20:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with scrape type 2
2026-03-29 20:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with scrape type 2
2026-03-29 20:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1, identifier: ND89972
2026-03-29 20:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-29 20:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972
2026-03-29 20:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1 with identifier: ND89972 to the API
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:35:58Z',
 'fuel_type': 'petrol',
 'id': '85d07df1-6d75-5f0b-b3c4-51fa7ae0a1a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND89972',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 14358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 35 AMG Shooting Brake Mild-Hybrid '
          '4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [auto1.be] INFO: Saving data for ND89972: {'auction_closing_time': 1774884958.0, 'created_time': 1773132509.81165, 'last_price_update_time': 1774816235.396837}
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND89972') HTTP/1.1" 204 0
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [auto1.be] INFO: Scrape type for LG37246: 2
2026-03-29 20:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-29 20:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with scrape type 2
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with scrape type 2
2026-03-29 20:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df, identifier: LG37246
2026-03-29 20:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246
2026-03-29 20:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a889c8a-1f00-5397-a9ff-f61e47b2d1df with identifier: LG37246 to the API
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:28Z',
 'fuel_type': 'diesel',
 'id': '9a889c8a-1f00-5397-a9ff-f61e47b2d1df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG37246',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 98367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2012}
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [auto1.be] INFO: Saving data for LG37246: {'auction_closing_time': 1774884628.0, 'created_time': 1773747312.111392, 'last_price_update_time': 1774816235.960748}
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG37246') HTTP/1.1" 204 0
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [auto1.be] INFO: Scrape type for FB34577: 0
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 20:30:35 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-29 20:30:36 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-29 20:30:36 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 20:30:36 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 20:30:36 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 20:30:36 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-29 20:30:36 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-29 20:30:36 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 20:30:36 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-29 20:30:36 [auto1.be] INFO: Scrape type for GL29646: 2
2026-03-29 20:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-29 20:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ccd02e-4416-5222-beb2-efe77ba4ccab with scrape type 2
2026-03-29 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ccd02e-4416-5222-beb2-efe77ba4ccab with scrape type 2
2026-03-29 20:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96ccd02e-4416-5222-beb2-efe77ba4ccab, identifier: GL29646
2026-03-29 20:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-29 20:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646
2026-03-29 20:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96ccd02e-4416-5222-beb2-efe77ba4ccab with identifier: GL29646 to the API
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:49:01Z',
 'fuel_type': 'diesel',
 'id': '96ccd02e-4416-5222-beb2-efe77ba4ccab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL29646',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 123162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2011}
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-29 20:30:36 [auto1.be] INFO: Saving data for GL29646: {'auction_closing_time': 1774885741.0, 'created_time': 1773520431.735694, 'last_price_update_time': 1774816236.454323}
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GL29646') HTTP/1.1" 204 0
2026-03-29 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:40 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:40 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [auto1.be] INFO: Scrape type for ZG73435: 2
2026-03-29 20:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435
2026-03-29 20:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with scrape type 2
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with scrape type 2
2026-03-29 20:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58, identifier: ZG73435
2026-03-29 20:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435
2026-03-29 20:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435
2026-03-29 20:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39ac1679-cb3e-5b5f-8e00-4b103f8b9b58 with identifier: ZG73435 to the API
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:19:52Z',
 'fuel_type': 'diesel',
 'id': '39ac1679-cb3e-5b5f-8e00-4b103f8b9b58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG73435',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 238491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-22',
 'seller_name': None,
 'title': 'BMW 7er 730d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Saving data for ZG73435: {'auction_closing_time': 1774883992.0, 'created_time': 1774513854.690711, 'last_price_update_time': 1774816241.097567}
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG73435') HTTP/1.1" 204 0
2026-03-29 20:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for MW76341: 2
2026-03-29 20:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-29 20:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f0e405-d36b-5478-8141-bf8484dde994 with scrape type 2
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f0e405-d36b-5478-8141-bf8484dde994 with scrape type 2
2026-03-29 20:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12f0e405-d36b-5478-8141-bf8484dde994, identifier: MW76341
2026-03-29 20:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-29 20:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341
2026-03-29 20:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12f0e405-d36b-5478-8141-bf8484dde994 with identifier: MW76341 to the API
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:05Z',
 'fuel_type': 'petrol',
 'id': '12f0e405-d36b-5478-8141-bf8484dde994',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW76341',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 64488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Saving data for MW76341: {'auction_closing_time': 1774884665.0, 'created_time': 1774611059.375446, 'last_price_update_time': 1774816241.60889}
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW76341') HTTP/1.1" 204 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-29 20:30:41 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-29 20:30:41 [auto1.be] INFO: Scrape type for NC25574: 2
2026-03-29 20:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-29 20:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224e1efe-488b-523a-a490-064d09792db1 with scrape type 2
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224e1efe-488b-523a-a490-064d09792db1 with scrape type 2
2026-03-29 20:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 224e1efe-488b-523a-a490-064d09792db1, identifier: NC25574
2026-03-29 20:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-29 20:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574
2026-03-29 20:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 224e1efe-488b-523a-a490-064d09792db1 with identifier: NC25574 to the API
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'diesel',
 'id': '224e1efe-488b-523a-a490-064d09792db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC25574',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 108325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Saving data for NC25574: {'auction_closing_time': 1774886071.0, 'created_time': 1773131939.556374, 'last_price_update_time': 1774816242.258002}
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC25574') HTTP/1.1" 204 0
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Scrape type for GD11285: 2
2026-03-29 20:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-29 20:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db12d969-99b5-5e66-afb2-b0420ae80955 with scrape type 2
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db12d969-99b5-5e66-afb2-b0420ae80955 with scrape type 2
2026-03-29 20:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db12d969-99b5-5e66-afb2-b0420ae80955, identifier: GD11285
2026-03-29 20:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-29 20:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285
2026-03-29 20:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db12d969-99b5-5e66-afb2-b0420ae80955 with identifier: GD11285 to the API
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:24:43Z',
 'fuel_type': 'petrol',
 'id': 'db12d969-99b5-5e66-afb2-b0420ae80955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD11285',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 79717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-04',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Saving data for GD11285: {'auction_closing_time': 1774884283.0, 'created_time': 1773133000.887376, 'last_price_update_time': 1774816242.816886}
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GD11285') HTTP/1.1" 204 0
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 20:30:42 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-29 20:30:42 [auto1.be] INFO: Scrape type for CC17071: 2
2026-03-29 20:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-29 20:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9609db3f-592b-5e29-9fc3-b596139b736a with scrape type 2
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9609db3f-592b-5e29-9fc3-b596139b736a with scrape type 2
2026-03-29 20:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9609db3f-592b-5e29-9fc3-b596139b736a, identifier: CC17071
2026-03-29 20:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-29 20:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071
2026-03-29 20:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9609db3f-592b-5e29-9fc3-b596139b736a with identifier: CC17071 to the API
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:29:41Z',
 'fuel_type': 'diesel',
 'id': '9609db3f-592b-5e29-9fc3-b596139b736a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC17071',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 192640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-16',
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-29 20:30:43 [auto1.be] INFO: Saving data for CC17071: {'auction_closing_time': 1774884581.0, 'created_time': 1774611068.05205, 'last_price_update_time': 1774816243.260983}
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC17071') HTTP/1.1" 204 0
2026-03-29 20:30:43 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-29 20:30:43 [auto1.be] INFO: Scrape type for KH63709: 2
2026-03-29 20:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-29 20:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 with scrape type 2
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa5cf44f-85cf-574c-9a6a-af491c81ab86 with scrape type 2
2026-03-29 20:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa5cf44f-85cf-574c-9a6a-af491c81ab86, identifier: KH63709
2026-03-29 20:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 20:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709
2026-03-29 20:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa5cf44f-85cf-574c-9a6a-af491c81ab86 with identifier: KH63709 to the API
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'petrol',
 'id': 'aa5cf44f-85cf-574c-9a6a-af491c81ab86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH63709',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 68939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Business 2WD',
 'transmission': 'automatic',
 'trim': 'Business 2WD',
 'year': 2020}
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-29 20:30:43 [auto1.be] INFO: Saving data for KH63709: {'auction_closing_time': 1774885242.0, 'created_time': 1774611074.870131, 'last_price_update_time': 1774816243.897607}
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH63709') HTTP/1.1" 204 0
2026-03-29 20:30:43 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-29 20:30:43 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-29 20:30:43 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 20:30:43 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-29 20:30:43 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-29 20:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:44 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:44 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-29 20:30:44 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-29 20:30:44 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-29 20:30:44 [auto1.be] INFO: Scrape type for WA92632: 2
2026-03-29 20:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-29 20:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with scrape type 2
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with scrape type 2
2026-03-29 20:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479, identifier: WA92632
2026-03-29 20:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-29 20:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632
2026-03-29 20:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 325dacdd-d8ce-5187-80f3-fdaa6b2f5479 with identifier: WA92632 to the API
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:57:51Z',
 'fuel_type': 'diesel',
 'id': '325dacdd-d8ce-5187-80f3-fdaa6b2f5479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA92632',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 284968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Mazda 5 1.6 CD Diesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-29 20:30:44 [auto1.be] INFO: Saving data for WA92632: {'auction_closing_time': 1774886271.0, 'created_time': 1773865920.347381, 'last_price_update_time': 1774816244.68341}
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA92632') HTTP/1.1" 204 0
2026-03-29 20:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:44 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 20:30:44 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-29 20:30:44 [auto1.be] INFO: Scrape type for RW14221: 2
2026-03-29 20:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-29 20:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532e3e3d-434a-58a8-92c5-32b9a70d214b with scrape type 2
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 532e3e3d-434a-58a8-92c5-32b9a70d214b with scrape type 2
2026-03-29 20:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 532e3e3d-434a-58a8-92c5-32b9a70d214b, identifier: RW14221
2026-03-29 20:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-29 20:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221
2026-03-29 20:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 532e3e3d-434a-58a8-92c5-32b9a70d214b with identifier: RW14221 to the API
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:48Z',
 'fuel_type': 'petrol',
 'id': '532e3e3d-434a-58a8-92c5-32b9a70d214b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW14221',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 128746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Saving data for RW14221: {'auction_closing_time': 1774883568.0, 'created_time': 1773952768.31199, 'last_price_update_time': 1774816245.169731}
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW14221') HTTP/1.1" 204 0
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Scrape type for LK29098: 2
2026-03-29 20:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098
2026-03-29 20:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4993b87a-8fcb-588a-8851-04301e638bf8 with scrape type 2
2026-03-29 20:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4993b87a-8fcb-588a-8851-04301e638bf8 with scrape type 2
2026-03-29 20:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4993b87a-8fcb-588a-8851-04301e638bf8, identifier: LK29098
2026-03-29 20:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098
2026-03-29 20:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098
2026-03-29 20:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4993b87a-8fcb-588a-8851-04301e638bf8 with identifier: LK29098 to the API
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:47:00Z',
 'fuel_type': 'diesel',
 'id': '4993b87a-8fcb-588a-8851-04301e638bf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK29098',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 160147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-25',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2013}
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Saving data for LK29098: {'auction_closing_time': 1774885620.0, 'created_time': 1773237983.79297, 'last_price_update_time': 1774816245.635193}
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK29098') HTTP/1.1" 204 0
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-29 20:30:45 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [auto1.be] INFO: Scrape type for BP14655: 2
2026-03-29 20:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-29 20:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with scrape type 2
2026-03-29 20:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with scrape type 2
2026-03-29 20:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9, identifier: BP14655
2026-03-29 20:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-29 20:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655
2026-03-29 20:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2111ab50-e1c7-5a65-9c0e-62a3443fc0e9 with identifier: BP14655 to the API
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:32:39Z',
 'fuel_type': 'petrol',
 'id': '2111ab50-e1c7-5a65-9c0e-62a3443fc0e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP14655',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 82255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid GLE',
 'transmission': 'manual',
 'trim': 'GLE',
 'year': 2020}
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Saving data for BP14655: {'auction_closing_time': 1774884759.0, 'created_time': 1773866608.10521, 'last_price_update_time': 1774816246.20868}
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP14655') HTTP/1.1" 204 0
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Scrape type for HB19534: 2
2026-03-29 20:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-29 20:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7c6609-2f10-5d13-9ef1-ff7bac632954 with scrape type 2
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7c6609-2f10-5d13-9ef1-ff7bac632954 with scrape type 2
2026-03-29 20:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb7c6609-2f10-5d13-9ef1-ff7bac632954, identifier: HB19534
2026-03-29 20:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-29 20:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534
2026-03-29 20:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb7c6609-2f10-5d13-9ef1-ff7bac632954 with identifier: HB19534 to the API
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:23Z',
 'fuel_type': 'diesel',
 'id': 'cb7c6609-2f10-5d13-9ef1-ff7bac632954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB19534',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 161681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Saving data for HB19534: {'auction_closing_time': 1774885523.0, 'created_time': 1773301720.088691, 'last_price_update_time': 1774816246.687214}
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB19534') HTTP/1.1" 204 0
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 20:30:46 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [auto1.be] INFO: Scrape type for MC44479: 2
2026-03-29 20:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-29 20:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4eca24b-c4ad-563a-8208-c53776c7a282 with scrape type 2
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4eca24b-c4ad-563a-8208-c53776c7a282 with scrape type 2
2026-03-29 20:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4eca24b-c4ad-563a-8208-c53776c7a282, identifier: MC44479
2026-03-29 20:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-29 20:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479
2026-03-29 20:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4eca24b-c4ad-563a-8208-c53776c7a282 with identifier: MC44479 to the API
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:21Z',
 'fuel_type': 'diesel',
 'id': 'e4eca24b-c4ad-563a-8208-c53776c7a282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC44479',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 24280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-12',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-29 20:30:47 [auto1.be] INFO: Saving data for MC44479: {'auction_closing_time': 1774885101.0, 'created_time': 1774611073.115855, 'last_price_update_time': 1774816247.236426}
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC44479') HTTP/1.1" 204 0
2026-03-29 20:30:47 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 20:30:47 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-29 20:30:47 [auto1.be] INFO: Scrape type for SC04496: 2
2026-03-29 20:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-29 20:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99fa020-c354-5391-9f85-b5505442b785 with scrape type 2
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99fa020-c354-5391-9f85-b5505442b785 with scrape type 2
2026-03-29 20:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c99fa020-c354-5391-9f85-b5505442b785, identifier: SC04496
2026-03-29 20:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-29 20:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496
2026-03-29 20:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c99fa020-c354-5391-9f85-b5505442b785 with identifier: SC04496 to the API
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:06Z',
 'fuel_type': 'diesel',
 'id': 'c99fa020-c354-5391-9f85-b5505442b785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC04496',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-29 20:30:47 [auto1.be] INFO: Saving data for SC04496: {'auction_closing_time': 1774884906.0, 'created_time': 1774611055.380757, 'last_price_update_time': 1774816247.658415}
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC04496') HTTP/1.1" 204 0
2026-03-29 20:30:47 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 20:30:47 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-29 20:30:47 [auto1.be] INFO: Scrape type for XJ47711: 2
2026-03-29 20:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-29 20:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19227997-8039-5f82-8183-48fcfde7f983 with scrape type 2
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19227997-8039-5f82-8183-48fcfde7f983 with scrape type 2
2026-03-29 20:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19227997-8039-5f82-8183-48fcfde7f983, identifier: XJ47711
2026-03-29 20:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-29 20:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711
2026-03-29 20:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19227997-8039-5f82-8183-48fcfde7f983 with identifier: XJ47711 to the API
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:09:33Z',
 'fuel_type': 'hybrid',
 'id': '19227997-8039-5f82-8183-48fcfde7f983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ47711',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 63370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2021}
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Saving data for XJ47711: {'auction_closing_time': 1774883373.0, 'created_time': 1773693588.366722, 'last_price_update_time': 1774816248.073955}
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ47711') HTTP/1.1" 204 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for DP96573: 2
2026-03-29 20:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-29 20:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bcbf188-681f-5ef8-915a-1befaf5e4bff with scrape type 2
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bcbf188-681f-5ef8-915a-1befaf5e4bff with scrape type 2
2026-03-29 20:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3bcbf188-681f-5ef8-915a-1befaf5e4bff, identifier: DP96573
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-29 20:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573
2026-03-29 20:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3bcbf188-681f-5ef8-915a-1befaf5e4bff with identifier: DP96573 to the API
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:16:30Z',
 'fuel_type': 'petrol',
 'id': '3bcbf188-681f-5ef8-915a-1befaf5e4bff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP96573',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 151445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Saving data for DP96573: {'auction_closing_time': 1774883790.0, 'created_time': 1774611039.485237, 'last_price_update_time': 1774816248.538431}
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP96573') HTTP/1.1" 204 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 20:30:48 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 20:30:48 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [auto1.be] INFO: Scrape type for XM93272: 2
2026-03-29 20:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-29 20:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4357a86-d4f6-5e8e-969e-664e196b38d6 with scrape type 2
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4357a86-d4f6-5e8e-969e-664e196b38d6 with scrape type 2
2026-03-29 20:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4357a86-d4f6-5e8e-969e-664e196b38d6, identifier: XM93272
2026-03-29 20:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-29 20:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272
2026-03-29 20:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4357a86-d4f6-5e8e-969e-664e196b38d6 with identifier: XM93272 to the API
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:18:32Z',
 'fuel_type': 'diesel',
 'id': 'f4357a86-d4f6-5e8e-969e-664e196b38d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM93272',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 120936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-06',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2017}
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Saving data for XM93272: {'auction_closing_time': 1774883912.0, 'created_time': 1774611125.689432, 'last_price_update_time': 1774816249.131788}
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM93272') HTTP/1.1" 204 0
2026-03-29 20:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for ZM54310: 2
2026-03-29 20:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-29 20:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6523e0-a241-5558-8415-d2dc5206accb with scrape type 2
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f6523e0-a241-5558-8415-d2dc5206accb with scrape type 2
2026-03-29 20:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f6523e0-a241-5558-8415-d2dc5206accb, identifier: ZM54310
2026-03-29 20:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-29 20:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310
2026-03-29 20:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f6523e0-a241-5558-8415-d2dc5206accb with identifier: ZM54310 to the API
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:53:09Z',
 'fuel_type': 'petrol',
 'id': '6f6523e0-a241-5558-8415-d2dc5206accb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54310',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 123698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-08',
 'seller_name': None,
 'title': 'Peugeot 307 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2007}
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Saving data for ZM54310: {'auction_closing_time': 1774885989.0, 'created_time': 1774611072.593123, 'last_price_update_time': 1774816249.788794}
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM54310') HTTP/1.1" 204 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 20:30:49 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [auto1.be] INFO: Scrape type for ST89131: 2
2026-03-29 20:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-29 20:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with scrape type 2
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with scrape type 2
2026-03-29 20:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a, identifier: ST89131
2026-03-29 20:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-29 20:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131
2026-03-29 20:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1dea36b-77b5-5b3e-81d5-a5d50db97f6a with identifier: ST89131 to the API
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:04:14Z',
 'fuel_type': 'diesel',
 'id': 'd1dea36b-77b5-5b3e-81d5-a5d50db97f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST89131',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 184032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi 4x2',
 'transmission': 'manual',
 'trim': '4x2',
 'year': 2013}
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [auto1.be] INFO: Saving data for ST89131: {'auction_closing_time': 1774883054.0, 'created_time': 1773224956.501311, 'last_price_update_time': 1774816250.341629}
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST89131') HTTP/1.1" 204 0
2026-03-29 20:30:50 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 20:30:50 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-29 20:30:50 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 20:30:50 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 20:30:50 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:51 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:51 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 20:30:51 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 20:30:51 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 20:30:51 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 20:30:51 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [auto1.be] INFO: Scrape type for MB19665: 2
2026-03-29 20:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665
2026-03-29 20:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088821b5-26e9-5a2f-8721-8916b6110d40 with scrape type 2
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088821b5-26e9-5a2f-8721-8916b6110d40 with scrape type 2
2026-03-29 20:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 088821b5-26e9-5a2f-8721-8916b6110d40, identifier: MB19665
2026-03-29 20:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665
2026-03-29 20:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665
2026-03-29 20:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 088821b5-26e9-5a2f-8721-8916b6110d40 with identifier: MB19665 to the API
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:57:14Z',
 'fuel_type': 'diesel',
 'id': '088821b5-26e9-5a2f-8721-8916b6110d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB19665',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 102364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [auto1.be] INFO: Saving data for MB19665: {'auction_closing_time': 1774886234.0, 'created_time': 1774513891.479441, 'last_price_update_time': 1774816251.936194}
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB19665') HTTP/1.1" 204 0
2026-03-29 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:51 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [auto1.be] INFO: Scrape type for SJ78748: 2
2026-03-29 20:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-29 20:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with scrape type 2
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with scrape type 2
2026-03-29 20:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a, identifier: SJ78748
2026-03-29 20:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-29 20:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748
2026-03-29 20:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7560812a-7c8c-5f8f-83a6-3ba82ffaae2a with identifier: SJ78748 to the API
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:06:31Z',
 'fuel_type': 'diesel',
 'id': '7560812a-7c8c-5f8f-83a6-3ba82ffaae2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ78748',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 189244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-29 20:30:52 [auto1.be] INFO: Saving data for SJ78748: {'auction_closing_time': 1774883191.0, 'created_time': 1773747449.61006, 'last_price_update_time': 1774816252.341021}
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ78748') HTTP/1.1" 204 0
2026-03-29 20:30:52 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-29 20:30:52 [auto1.be] INFO: Scrape type for UM90025: 2
2026-03-29 20:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025
2026-03-29 20:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with scrape type 2
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with scrape type 2
2026-03-29 20:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8f3efbc-4f27-59c7-b27c-6e57c5429c55, identifier: UM90025
2026-03-29 20:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025
2026-03-29 20:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025
2026-03-29 20:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8f3efbc-4f27-59c7-b27c-6e57c5429c55 with identifier: UM90025 to the API
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:30:34Z',
 'fuel_type': 'diesel',
 'id': 'a8f3efbc-4f27-59c7-b27c-6e57c5429c55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM90025',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 114490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2014}
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-29 20:30:52 [auto1.be] INFO: Saving data for UM90025: {'auction_closing_time': 1774884634.0, 'created_time': 1774125036.435699, 'last_price_update_time': 1774816252.830434}
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM90025') HTTP/1.1" 204 0
2026-03-29 20:30:52 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 20:30:52 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 20:30:52 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-29 20:30:52 [auto1.be] INFO: Scrape type for LW74134: 2
2026-03-29 20:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134
2026-03-29 20:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 897afe7f-048a-5c1b-9083-014581bddd00 with scrape type 2
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 897afe7f-048a-5c1b-9083-014581bddd00 with scrape type 2
2026-03-29 20:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 897afe7f-048a-5c1b-9083-014581bddd00, identifier: LW74134
2026-03-29 20:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134
2026-03-29 20:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134
2026-03-29 20:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 897afe7f-048a-5c1b-9083-014581bddd00 with identifier: LW74134 to the API
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:59:23Z',
 'fuel_type': 'petrol',
 'id': '897afe7f-048a-5c1b-9083-014581bddd00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW74134',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 102910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Saving data for LW74134: {'auction_closing_time': 1774886363.0, 'created_time': 1774125072.905653, 'last_price_update_time': 1774816253.24966}
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LW74134') HTTP/1.1" 204 0
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Scrape type for KD31542: 2
2026-03-29 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-29 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b610291a-d6ec-5e07-83c5-c74f2366cddc with scrape type 2
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b610291a-d6ec-5e07-83c5-c74f2366cddc with scrape type 2
2026-03-29 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b610291a-d6ec-5e07-83c5-c74f2366cddc, identifier: KD31542
2026-03-29 20:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-29 20:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542
2026-03-29 20:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b610291a-d6ec-5e07-83c5-c74f2366cddc with identifier: KD31542 to the API
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:30Z',
 'fuel_type': 'diesel',
 'id': 'b610291a-d6ec-5e07-83c5-c74f2366cddc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD31542',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 209678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2010}
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Saving data for KD31542: {'auction_closing_time': 1774884450.0, 'created_time': 1773747320.527256, 'last_price_update_time': 1774816253.70812}
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD31542') HTTP/1.1" 204 0
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 20:30:53 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [auto1.be] INFO: Scrape type for DB63111: 2
2026-03-29 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-29 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2aedc04-bdda-5b21-989c-f90552752a3d with scrape type 2
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2aedc04-bdda-5b21-989c-f90552752a3d with scrape type 2
2026-03-29 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2aedc04-bdda-5b21-989c-f90552752a3d, identifier: DB63111
2026-03-29 20:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-29 20:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111
2026-03-29 20:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2aedc04-bdda-5b21-989c-f90552752a3d with identifier: DB63111 to the API
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:27Z',
 'fuel_type': 'petrol',
 'id': 'a2aedc04-bdda-5b21-989c-f90552752a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB63111',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 212010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Kia Rio 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Saving data for DB63111: {'auction_closing_time': 1774883247.0, 'created_time': 1773866464.842481, 'last_price_update_time': 1774816254.268983}
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB63111') HTTP/1.1" 204 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for UA98228: 2
2026-03-29 20:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-29 20:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4ae1a9-8910-597b-8128-538de3e6069c with scrape type 2
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4ae1a9-8910-597b-8128-538de3e6069c with scrape type 2
2026-03-29 20:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d4ae1a9-8910-597b-8128-538de3e6069c, identifier: UA98228
2026-03-29 20:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-29 20:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228
2026-03-29 20:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d4ae1a9-8910-597b-8128-538de3e6069c with identifier: UA98228 to the API
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:15Z',
 'fuel_type': 'diesel',
 'id': '9d4ae1a9-8910-597b-8128-538de3e6069c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA98228',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 160588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Saving data for UA98228: {'auction_closing_time': 1774884615.0, 'created_time': 1773833650.804224, 'last_price_update_time': 1774816254.789661}
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA98228') HTTP/1.1" 204 0
2026-03-29 20:30:54 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-29 20:30:54 [auto1.be] INFO: Scrape type for VT00410: 2
2026-03-29 20:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-29 20:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec496ded-d4e0-525b-b85d-3e85669a7518 with scrape type 2
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec496ded-d4e0-525b-b85d-3e85669a7518 with scrape type 2
2026-03-29 20:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec496ded-d4e0-525b-b85d-3e85669a7518, identifier: VT00410
2026-03-29 20:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-29 20:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410
2026-03-29 20:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec496ded-d4e0-525b-b85d-3e85669a7518 with identifier: VT00410 to the API
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:54:54Z',
 'fuel_type': 'petrol',
 'id': 'ec496ded-d4e0-525b-b85d-3e85669a7518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT00410',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 95103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Futura',
 'transmission': 'manual',
 'trim': 'Futura',
 'year': 2005}
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [auto1.be] INFO: Saving data for VT00410: {'auction_closing_time': 1774886094.0, 'created_time': 1774611035.23839, 'last_price_update_time': 1774816255.28105}
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VT00410') HTTP/1.1" 204 0
2026-03-29 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:55 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 20:30:55 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1260 | hits on page: 40
2026-03-29 20:30:55 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-29 20:30:55 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-29 20:30:55 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [auto1.be] INFO: Scrape type for TH19224: 2
2026-03-29 20:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-29 20:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f668b3b-4f59-5cf7-8358-d016400cd4ce with scrape type 2
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f668b3b-4f59-5cf7-8358-d016400cd4ce with scrape type 2
2026-03-29 20:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f668b3b-4f59-5cf7-8358-d016400cd4ce, identifier: TH19224
2026-03-29 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-29 20:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224
2026-03-29 20:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f668b3b-4f59-5cf7-8358-d016400cd4ce with identifier: TH19224 to the API
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:04:56Z',
 'fuel_type': 'petrol',
 'id': '8f668b3b-4f59-5cf7-8358-d016400cd4ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH19224',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 65179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [auto1.be] INFO: Saving data for TH19224: {'auction_closing_time': 1774883096.0, 'created_time': 1773833924.784205, 'last_price_update_time': 1774816255.819258}
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH19224') HTTP/1.1" 204 0
2026-03-29 20:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:55 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [auto1.be] INFO: Scrape type for XE73160: 2
2026-03-29 20:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-29 20:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with scrape type 2
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with scrape type 2
2026-03-29 20:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc, identifier: XE73160
2026-03-29 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-29 20:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160
2026-03-29 20:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eefabaa-9783-5e72-8cc3-9dc4062c79fc with identifier: XE73160 to the API
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:43:21Z',
 'fuel_type': 'diesel',
 'id': '6eefabaa-9783-5e72-8cc3-9dc4062c79fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE73160',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 184151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-22',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-29 20:30:56 [auto1.be] INFO: Saving data for XE73160: {'auction_closing_time': 1774885401.0, 'created_time': 1773693900.046291, 'last_price_update_time': 1774816256.227278}
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE73160') HTTP/1.1" 204 0
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-29 20:30:56 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-29 20:30:56 [auto1.be] INFO: Scrape type for WH41445: 2
2026-03-29 20:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-29 20:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c57867-c58f-5b18-9431-bbd8d599383b with scrape type 2
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c57867-c58f-5b18-9431-bbd8d599383b with scrape type 2
2026-03-29 20:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 74c57867-c58f-5b18-9431-bbd8d599383b, identifier: WH41445
2026-03-29 20:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-29 20:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445
2026-03-29 20:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 74c57867-c58f-5b18-9431-bbd8d599383b with identifier: WH41445 to the API
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:17Z',
 'fuel_type': 'diesel',
 'id': '74c57867-c58f-5b18-9431-bbd8d599383b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH41445',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 59167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-21',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-29 20:30:56 [auto1.be] INFO: Saving data for WH41445: {'auction_closing_time': 1774883117.0, 'created_time': 1774611049.547412, 'last_price_update_time': 1774816256.658859}
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH41445') HTTP/1.1" 204 0
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 20:30:56 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-29 20:30:56 [auto1.be] INFO: Scrape type for CB86664: 2
2026-03-29 20:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-29 20:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8f4039-3298-571a-9f56-fb3bf3761e99 with scrape type 2
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8f4039-3298-571a-9f56-fb3bf3761e99 with scrape type 2
2026-03-29 20:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab8f4039-3298-571a-9f56-fb3bf3761e99, identifier: CB86664
2026-03-29 20:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-29 20:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664
2026-03-29 20:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab8f4039-3298-571a-9f56-fb3bf3761e99 with identifier: CB86664 to the API
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:16:57Z',
 'fuel_type': 'petrol',
 'id': 'ab8f4039-3298-571a-9f56-fb3bf3761e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB86664',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 103072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2022}
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-29 20:30:57 [auto1.be] INFO: Saving data for CB86664: {'auction_closing_time': 1774883817.0, 'created_time': 1773866591.722398, 'last_price_update_time': 1774816257.206463}
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB86664') HTTP/1.1" 204 0
2026-03-29 20:30:57 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 20:30:57 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-29 20:30:57 [auto1.be] INFO: Scrape type for ZK51965: 2
2026-03-29 20:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-29 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with scrape type 2
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with scrape type 2
2026-03-29 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a, identifier: ZK51965
2026-03-29 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965
2026-03-29 20:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4fd9ad0a-1898-5ffe-bb37-005a1e46345a with identifier: ZK51965 to the API
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:51:36Z',
 'fuel_type': 'diesel',
 'id': '4fd9ad0a-1898-5ffe-bb37-005a1e46345a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51965',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 249855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-29 20:30:57 [auto1.be] INFO: Saving data for ZK51965: {'auction_closing_time': 1774885896.0, 'created_time': 1773661632.6523, 'last_price_update_time': 1774816257.792997}
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK51965') HTTP/1.1" 204 0
2026-03-29 20:30:57 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-29 20:30:57 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-29 20:30:57 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-29 20:30:57 [auto1.be] INFO: Scrape type for EP09858: 2
2026-03-29 20:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-29 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e537b69b-6ce4-5e73-9c9e-7817832184b8 with scrape type 2
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e537b69b-6ce4-5e73-9c9e-7817832184b8 with scrape type 2
2026-03-29 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e537b69b-6ce4-5e73-9c9e-7817832184b8, identifier: EP09858
2026-03-29 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-29 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858
2026-03-29 20:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e537b69b-6ce4-5e73-9c9e-7817832184b8 with identifier: EP09858 to the API
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:23Z',
 'fuel_type': 'diesel',
 'id': 'e537b69b-6ce4-5e73-9c9e-7817832184b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP09858',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 69950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Saving data for EP09858: {'auction_closing_time': 1774885703.0, 'created_time': 1774611066.959538, 'last_price_update_time': 1774816258.232012}
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP09858') HTTP/1.1" 204 0
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Scrape type for GW63299: 2
2026-03-29 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-29 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dddbf5c-4eb8-53ae-8520-608843c459ab with scrape type 2
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dddbf5c-4eb8-53ae-8520-608843c459ab with scrape type 2
2026-03-29 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dddbf5c-4eb8-53ae-8520-608843c459ab, identifier: GW63299
2026-03-29 20:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-29 20:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299
2026-03-29 20:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dddbf5c-4eb8-53ae-8520-608843c459ab with identifier: GW63299 to the API
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:55Z',
 'fuel_type': 'petrol',
 'id': '3dddbf5c-4eb8-53ae-8520-608843c459ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW63299',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 118194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Saving data for GW63299: {'auction_closing_time': 1774884415.0, 'created_time': 1774611058.362266, 'last_price_update_time': 1774816258.726487}
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW63299') HTTP/1.1" 204 0
2026-03-29 20:30:58 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [auto1.be] INFO: Scrape type for JF41683: 2
2026-03-29 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683
2026-03-29 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with scrape type 2
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with scrape type 2
2026-03-29 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8, identifier: JF41683
2026-03-29 20:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683
2026-03-29 20:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683
2026-03-29 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 60c3a740-e601-52cc-90d1-e2e4e2e3e9e8 with identifier: JF41683 to the API
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '60c3a740-e601-52cc-90d1-e2e4e2e3e9e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF41683',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 115413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Saving data for JF41683: {'auction_closing_time': 1774884618.0, 'created_time': 1774513864.698212, 'last_price_update_time': 1774816259.225533}
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF41683') HTTP/1.1" 204 0
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Scrape type for GF63829: 2
2026-03-29 20:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-29 20:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da83eef-9ce5-50b7-b5f9-8652db35b71c with scrape type 2
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da83eef-9ce5-50b7-b5f9-8652db35b71c with scrape type 2
2026-03-29 20:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5da83eef-9ce5-50b7-b5f9-8652db35b71c, identifier: GF63829
2026-03-29 20:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-29 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829
2026-03-29 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5da83eef-9ce5-50b7-b5f9-8652db35b71c with identifier: GF63829 to the API
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:05:00Z',
 'fuel_type': 'diesel',
 'id': '5da83eef-9ce5-50b7-b5f9-8652db35b71c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF63829',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 201432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Saving data for GF63829: {'auction_closing_time': 1774883100.0, 'created_time': 1774611056.956269, 'last_price_update_time': 1774816259.720863}
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF63829') HTTP/1.1" 204 0
2026-03-29 20:30:59 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [auto1.be] INFO: Scrape type for JH02802: 2
2026-03-29 20:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-29 20:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5532df08-5d66-51db-a9ec-fec0f4890556 with scrape type 2
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5532df08-5d66-51db-a9ec-fec0f4890556 with scrape type 2
2026-03-29 20:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5532df08-5d66-51db-a9ec-fec0f4890556, identifier: JH02802
2026-03-29 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802
2026-03-29 20:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5532df08-5d66-51db-a9ec-fec0f4890556 with identifier: JH02802 to the API
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:57Z',
 'fuel_type': 'gas',
 'id': '5532df08-5d66-51db-a9ec-fec0f4890556',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH02802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 258891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TGI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2017}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [auto1.be] INFO: Saving data for JH02802: {'auction_closing_time': 1774886157.0, 'created_time': 1774265461.649245, 'last_price_update_time': 1774816260.301174}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH02802') HTTP/1.1" 204 0
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [auto1.be] INFO: Scrape type for EP14144: 2
2026-03-29 20:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-29 20:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01c72808-1ba6-5994-b029-1ddddb40490b with scrape type 2
2026-03-29 20:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01c72808-1ba6-5994-b029-1ddddb40490b with scrape type 2
2026-03-29 20:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01c72808-1ba6-5994-b029-1ddddb40490b, identifier: EP14144
2026-03-29 20:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-29 20:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144
2026-03-29 20:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01c72808-1ba6-5994-b029-1ddddb40490b with identifier: EP14144 to the API
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:03:13Z',
 'fuel_type': 'petrol',
 'id': '01c72808-1ba6-5994-b029-1ddddb40490b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP14144',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 119383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [auto1.be] INFO: Saving data for EP14144: {'auction_closing_time': 1774882993.0, 'created_time': 1774265454.642219, 'last_price_update_time': 1774816260.744238}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP14144') HTTP/1.1" 204 0
2026-03-29 20:31:00 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 20:31:00 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [auto1.be] INFO: Scrape type for JW58136: 2
2026-03-29 20:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-29 20:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c612b540-cffb-5a85-a102-e56dce025061 with scrape type 2
2026-03-29 20:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c612b540-cffb-5a85-a102-e56dce025061 with scrape type 2
2026-03-29 20:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c612b540-cffb-5a85-a102-e56dce025061, identifier: JW58136
2026-03-29 20:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-29 20:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136
2026-03-29 20:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c612b540-cffb-5a85-a102-e56dce025061 with identifier: JW58136 to the API
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:00Z',
 'fuel_type': 'petrol',
 'id': 'c612b540-cffb-5a85-a102-e56dce025061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW58136',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 171197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.8 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2010}
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-29 20:31:15 [auto1.be] INFO: Saving data for JW58136: {'auction_closing_time': 1774885920.0, 'created_time': 1773135663.676924, 'last_price_update_time': 1774816275.752717}
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW58136') HTTP/1.1" 204 0
2026-03-29 20:31:15 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 17 pages/min), scraped 50 items (at 50 items/min)
2026-03-29 20:31:15 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-29 20:31:15 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-29 20:31:15 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-29 20:31:15 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-29 20:31:15 [auto1.be] INFO: Scrape type for KW38150: 2
2026-03-29 20:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-29 20:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce9160-39cd-5582-a186-21b1728d97d7 with scrape type 2
2026-03-29 20:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ce9160-39cd-5582-a186-21b1728d97d7 with scrape type 2
2026-03-29 20:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 62ce9160-39cd-5582-a186-21b1728d97d7, identifier: KW38150
2026-03-29 20:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-29 20:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150
2026-03-29 20:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 62ce9160-39cd-5582-a186-21b1728d97d7 with identifier: KW38150 to the API
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:20:03Z',
 'fuel_type': 'petrol',
 'id': '62ce9160-39cd-5582-a186-21b1728d97d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW38150',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 154345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Saving data for KW38150: {'auction_closing_time': 1774884003.0, 'created_time': 1774611063.775505, 'last_price_update_time': 1774816276.18192}
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW38150') HTTP/1.1" 204 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 20:31:16 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [auto1.be] INFO: Scrape type for RX75304: 2
2026-03-29 20:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-29 20:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fab1503-6f64-5957-9420-b7a7ebe4cffd with scrape type 2
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fab1503-6f64-5957-9420-b7a7ebe4cffd with scrape type 2
2026-03-29 20:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fab1503-6f64-5957-9420-b7a7ebe4cffd, identifier: RX75304
2026-03-29 20:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-29 20:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304
2026-03-29 20:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fab1503-6f64-5957-9420-b7a7ebe4cffd with identifier: RX75304 to the API
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:13:40Z',
 'fuel_type': 'diesel',
 'id': '7fab1503-6f64-5957-9420-b7a7ebe4cffd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX75304',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 222184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-27',
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [auto1.be] INFO: Saving data for RX75304: {'auction_closing_time': 1774883620.0, 'created_time': 1773132646.591593, 'last_price_update_time': 1774816277.267888}
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX75304') HTTP/1.1" 204 0
2026-03-29 20:31:17 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [auto1.be] INFO: Scrape type for DG02903: 2
2026-03-29 20:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-29 20:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91a79f4-ed15-5009-a9b5-f1581580341f with scrape type 2
2026-03-29 20:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91a79f4-ed15-5009-a9b5-f1581580341f with scrape type 2
2026-03-29 20:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a91a79f4-ed15-5009-a9b5-f1581580341f, identifier: DG02903
2026-03-29 20:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 20:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903
2026-03-29 20:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a91a79f4-ed15-5009-a9b5-f1581580341f with identifier: DG02903 to the API
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'diesel',
 'id': 'a91a79f4-ed15-5009-a9b5-f1581580341f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG02903',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [auto1.be] INFO: Saving data for DG02903: {'auction_closing_time': 1774883713.0, 'created_time': 1773136052.126911, 'last_price_update_time': 1774816277.977218}
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DG02903') HTTP/1.1" 204 0
2026-03-29 20:31:17 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for AV28567: 2
2026-03-29 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-29 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with scrape type 2
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with scrape type 2
2026-03-29 20:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f, identifier: AV28567
2026-03-29 20:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-29 20:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567
2026-03-29 20:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f4c3fea-c5da-5a46-a72e-587bf909bd4f with identifier: AV28567 to the API
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:47Z',
 'fuel_type': 'petrol',
 'id': '2f4c3fea-c5da-5a46-a72e-587bf909bd4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV28567',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 191712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Saving data for AV28567: {'auction_closing_time': 1774886267.0, 'created_time': 1774611093.966959, 'last_price_update_time': 1774816278.433029}
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV28567') HTTP/1.1" 204 0
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for WB95668: 2
2026-03-29 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-29 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908eec7f-7516-5981-917f-04dc3b597b5e with scrape type 2
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908eec7f-7516-5981-917f-04dc3b597b5e with scrape type 2
2026-03-29 20:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 908eec7f-7516-5981-917f-04dc3b597b5e, identifier: WB95668
2026-03-29 20:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-29 20:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668
2026-03-29 20:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 908eec7f-7516-5981-917f-04dc3b597b5e with identifier: WB95668 to the API
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:13Z',
 'fuel_type': 'petrol',
 'id': '908eec7f-7516-5981-917f-04dc3b597b5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB95668',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 52050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-06',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Edition 30+ 2WD',
 'transmission': 'manual',
 'trim': 'Edition 30+ 2WD',
 'year': 2022}
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Saving data for WB95668: {'auction_closing_time': 1774884373.0, 'created_time': 1773834012.266552, 'last_price_update_time': 1774816278.852122}
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WB95668') HTTP/1.1" 204 0
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 20:31:18 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [auto1.be] INFO: Scrape type for VF88831: 2
2026-03-29 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-29 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with scrape type 2
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with scrape type 2
2026-03-29 20:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da, identifier: VF88831
2026-03-29 20:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-29 20:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831
2026-03-29 20:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1ae2a17-7b8d-51d1-8f5a-f01d30af17da with identifier: VF88831 to the API
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:51:20Z',
 'fuel_type': 'hybrid',
 'id': 'd1ae2a17-7b8d-51d1-8f5a-f01d30af17da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF88831',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 93038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Executive Line',
 'transmission': 'automatic',
 'trim': 'Executive Line',
 'year': 2013}
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [auto1.be] INFO: Saving data for VF88831: {'auction_closing_time': 1774885880.0, 'created_time': 1774611133.935131, 'last_price_update_time': 1774816279.302093}
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF88831') HTTP/1.1" 204 0
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [auto1.be] INFO: Scrape type for PS61885: 2
2026-03-29 20:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-29 20:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcda966d-d404-5865-9d88-beac13cfd6f7 with scrape type 2
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcda966d-d404-5865-9d88-beac13cfd6f7 with scrape type 2
2026-03-29 20:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcda966d-d404-5865-9d88-beac13cfd6f7, identifier: PS61885
2026-03-29 20:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-29 20:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885
2026-03-29 20:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcda966d-d404-5865-9d88-beac13cfd6f7 with identifier: PS61885 to the API
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:27Z',
 'fuel_type': 'diesel',
 'id': 'dcda966d-d404-5865-9d88-beac13cfd6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS61885',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 211796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [auto1.be] INFO: Saving data for PS61885: {'auction_closing_time': 1774885887.0, 'created_time': 1773922620.738167, 'last_price_update_time': 1774816279.809679}
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS61885') HTTP/1.1" 204 0
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 20:31:19 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:20 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-29 20:31:20 [auto1.be] INFO: Scrape type for XL26167: 0
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-29 20:31:20 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-29 20:31:20 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-29 20:31:20 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-29 20:31:20 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-29 20:31:20 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-29 20:31:20 [auto1.be] INFO: Scrape type for RU19747: 2
2026-03-29 20:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-29 20:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with scrape type 2
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with scrape type 2
2026-03-29 20:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65, identifier: RU19747
2026-03-29 20:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-29 20:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747
2026-03-29 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46ddd1a9-681c-5ace-8db4-b6c85f38cc65 with identifier: RU19747 to the API
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:30:11Z',
 'fuel_type': 'diesel',
 'id': '46ddd1a9-681c-5ace-8db4-b6c85f38cc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU19747',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 169117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Jaguar XE 20d E-Performance Portfolio',
 'transmission': 'automatic',
 'trim': 'E-Performance Portfolio',
 'year': 2016}
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Saving data for RU19747: {'auction_closing_time': 1774884611.0, 'created_time': 1773747500.759796, 'last_price_update_time': 1774816281.298568}
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU19747') HTTP/1.1" 204 0
2026-03-29 20:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for DY20434: 2
2026-03-29 20:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-29 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with scrape type 2
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with scrape type 2
2026-03-29 20:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4, identifier: DY20434
2026-03-29 20:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-29 20:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434
2026-03-29 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e80a2ae7-c135-5e4f-9d8c-521e8283a6c4 with identifier: DY20434 to the API
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:14Z',
 'fuel_type': 'petrol',
 'id': 'e80a2ae7-c135-5e4f-9d8c-521e8283a6c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY20434',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 62028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2018}
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Saving data for DY20434: {'auction_closing_time': 1774883954.0, 'created_time': 1773134852.990224, 'last_price_update_time': 1774816281.919239}
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY20434') HTTP/1.1" 204 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 20:31:21 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [auto1.be] INFO: Scrape type for XC97675: 2
2026-03-29 20:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-29 20:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c08361-dc63-50b9-9ce6-35e857cb8458 with scrape type 2
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c08361-dc63-50b9-9ce6-35e857cb8458 with scrape type 2
2026-03-29 20:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3c08361-dc63-50b9-9ce6-35e857cb8458, identifier: XC97675
2026-03-29 20:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675
2026-03-29 20:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3c08361-dc63-50b9-9ce6-35e857cb8458 with identifier: XC97675 to the API
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:37:07Z',
 'fuel_type': 'petrol',
 'id': 'e3c08361-dc63-50b9-9ce6-35e857cb8458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC97675',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 60391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [auto1.be] INFO: Saving data for XC97675: {'auction_closing_time': 1774885027.0, 'created_time': 1773909048.240341, 'last_price_update_time': 1774816282.517993}
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC97675') HTTP/1.1" 204 0
2026-03-29 20:31:22 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 20:31:22 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-29 20:31:22 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 20:31:22 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-29 20:31:22 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-29 20:31:22 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:23 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:23 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-29 20:31:23 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [auto1.be] INFO: Scrape type for MK11042: 2
2026-03-29 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042
2026-03-29 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with scrape type 2
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with scrape type 2
2026-03-29 20:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd, identifier: MK11042
2026-03-29 20:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042
2026-03-29 20:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042
2026-03-29 20:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd with identifier: MK11042 to the API
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:19:58Z',
 'fuel_type': 'petrol',
 'id': 'c1a1931a-4a90-5a4f-835a-c2cf25e6f0fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK11042',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'SRX',
 'odometer': 250249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'Cadillac SRX 3.6 V6 AWD Elegance',
 'transmission': 'automatic',
 'trim': 'AWD Elegance',
 'year': 2007}
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [auto1.be] INFO: Saving data for MK11042: {'auction_closing_time': 1774883998.0, 'created_time': 1774513859.243721, 'last_price_update_time': 1774816283.961501}
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK11042') HTTP/1.1" 204 0
2026-03-29 20:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:23 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 20:31:23 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 20:31:23 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 20:31:23 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Scrape type for SX30605: 0
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Scrape type for AX51995: 2
2026-03-29 20:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-29 20:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with scrape type 2
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with scrape type 2
2026-03-29 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39a73c7c-2447-5e92-aab5-6f3ccf58a987, identifier: AX51995
2026-03-29 20:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-29 20:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995
2026-03-29 20:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39a73c7c-2447-5e92-aab5-6f3ccf58a987 with identifier: AX51995 to the API
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:28:21Z',
 'fuel_type': 'diesel',
 'id': '39a73c7c-2447-5e92-aab5-6f3ccf58a987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX51995',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Saving data for AX51995: {'auction_closing_time': 1774884501.0, 'created_time': 1773520258.113219, 'last_price_update_time': 1774816284.413418}
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX51995') HTTP/1.1" 204 0
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 20:31:24 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Scrape type for ED70069: 2
2026-03-29 20:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-29 20:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with scrape type 2
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with scrape type 2
2026-03-29 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43, identifier: ED70069
2026-03-29 20:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-29 20:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069
2026-03-29 20:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff0f0b1a-bba0-5416-b990-3a04b2bc2a43 with identifier: ED70069 to the API
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:59Z',
 'fuel_type': 'diesel',
 'id': 'ff0f0b1a-bba0-5416-b990-3a04b2bc2a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED70069',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 89813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-29 20:31:24 [auto1.be] INFO: Saving data for ED70069: {'auction_closing_time': 1774884599.0, 'created_time': 1774297847.773704, 'last_price_update_time': 1774816284.991925}
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED70069') HTTP/1.1" 204 0
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Scrape type for XE15288: 2
2026-03-29 20:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-29 20:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with scrape type 2
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with scrape type 2
2026-03-29 20:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f4381f0-d177-54d8-b3af-360b8f13e6f7, identifier: XE15288
2026-03-29 20:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-29 20:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288
2026-03-29 20:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f4381f0-d177-54d8-b3af-360b8f13e6f7 with identifier: XE15288 to the API
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:03:39Z',
 'fuel_type': 'diesel',
 'id': '1f4381f0-d177-54d8-b3af-360b8f13e6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE15288',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 345528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-09',
 'seller_name': None,
 'title': 'BMW 5er 530d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Saving data for XE15288: {'auction_closing_time': 1774883019.0, 'created_time': 1774384386.313011, 'last_price_update_time': 1774816285.406117}
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE15288') HTTP/1.1" 204 0
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Scrape type for YX48939: 2
2026-03-29 20:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-29 20:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dcbd62c-38df-5370-94cc-79408beef08a with scrape type 2
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dcbd62c-38df-5370-94cc-79408beef08a with scrape type 2
2026-03-29 20:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dcbd62c-38df-5370-94cc-79408beef08a, identifier: YX48939
2026-03-29 20:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-29 20:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939
2026-03-29 20:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dcbd62c-38df-5370-94cc-79408beef08a with identifier: YX48939 to the API
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:58:25Z',
 'fuel_type': 'hybrid',
 'id': '3dcbd62c-38df-5370-94cc-79408beef08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX48939',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 36261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [auto1.be] INFO: Saving data for YX48939: {'auction_closing_time': 1774886305.0, 'created_time': 1774611130.548507, 'last_price_update_time': 1774816285.971927}
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX48939') HTTP/1.1" 204 0
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 20:31:25 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [auto1.be] INFO: Scrape type for LW38679: 2
2026-03-29 20:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-29 20:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with scrape type 2
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with scrape type 2
2026-03-29 20:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9, identifier: LW38679
2026-03-29 20:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-29 20:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679
2026-03-29 20:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b40f512-5bf0-5bfd-8594-c6ae5f4faad9 with identifier: LW38679 to the API
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:54Z',
 'fuel_type': 'diesel',
 'id': '1b40f512-5bf0-5bfd-8594-c6ae5f4faad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW38679',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 225826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-23',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [auto1.be] INFO: Saving data for LW38679: {'auction_closing_time': 1774884954.0, 'created_time': 1774125133.712567, 'last_price_update_time': 1774816286.44239}
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LW38679') HTTP/1.1" 204 0
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [auto1.be] INFO: Scrape type for UW21644: 2
2026-03-29 20:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-29 20:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85aef54-640f-5d98-9b99-1c2927a173a1 with scrape type 2
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85aef54-640f-5d98-9b99-1c2927a173a1 with scrape type 2
2026-03-29 20:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d85aef54-640f-5d98-9b99-1c2927a173a1, identifier: UW21644
2026-03-29 20:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-29 20:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644
2026-03-29 20:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d85aef54-640f-5d98-9b99-1c2927a173a1 with identifier: UW21644 to the API
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:50:43Z',
 'fuel_type': 'diesel',
 'id': 'd85aef54-640f-5d98-9b99-1c2927a173a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW21644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 259485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [auto1.be] INFO: Saving data for UW21644: {'auction_closing_time': 1774885843.0, 'created_time': 1774611054.735589, 'last_price_update_time': 1774816286.855298}
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW21644') HTTP/1.1" 204 0
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [auto1.be] INFO: Scrape type for MJ77172: 0
2026-03-29 20:31:26 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [auto1.be] INFO: Scrape type for RR03336: 2
2026-03-29 20:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-29 20:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa70c8d-d199-54f0-9df1-1d5f6845390c with scrape type 2
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fa70c8d-d199-54f0-9df1-1d5f6845390c with scrape type 2
2026-03-29 20:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2fa70c8d-d199-54f0-9df1-1d5f6845390c, identifier: RR03336
2026-03-29 20:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-29 20:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336
2026-03-29 20:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2fa70c8d-d199-54f0-9df1-1d5f6845390c with identifier: RR03336 to the API
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:20Z',
 'fuel_type': 'diesel',
 'id': '2fa70c8d-d199-54f0-9df1-1d5f6845390c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR03336',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Liana',
 'odometer': 111306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-18',
 'seller_name': None,
 'title': 'Suzuki Liana 1.4 DDiS',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [auto1.be] INFO: Saving data for RR03336: {'auction_closing_time': 1774882820.0, 'created_time': 1773132095.254832, 'last_price_update_time': 1774816287.447449}
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR03336') HTTP/1.1" 204 0
2026-03-29 20:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:27 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 20:31:27 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [auto1.be] INFO: Scrape type for PF95077: 2
2026-03-29 20:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-29 20:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b2988d4-1154-5132-92c8-31545762130b with scrape type 2
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b2988d4-1154-5132-92c8-31545762130b with scrape type 2
2026-03-29 20:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b2988d4-1154-5132-92c8-31545762130b, identifier: PF95077
2026-03-29 20:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-29 20:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077
2026-03-29 20:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b2988d4-1154-5132-92c8-31545762130b with identifier: PF95077 to the API
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:21:09Z',
 'fuel_type': 'diesel',
 'id': '3b2988d4-1154-5132-92c8-31545762130b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF95077',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 202592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-24',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-29 20:31:28 [auto1.be] INFO: Saving data for PF95077: {'auction_closing_time': 1774884069.0, 'created_time': 1773237022.44888, 'last_price_update_time': 1774816288.059062}
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF95077') HTTP/1.1" 204 0
2026-03-29 20:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-29 20:31:28 [auto1.be] INFO: Scrape type for WE56106: 2
2026-03-29 20:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-29 20:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with scrape type 2
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with scrape type 2
2026-03-29 20:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb, identifier: WE56106
2026-03-29 20:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-29 20:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-29 20:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106 to the API
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:54:26Z',
 'fuel_type': 'petrol',
 'id': '4a9af0a5-cad6-5f58-82c0-94270c54b4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE56106',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 153607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-29 20:31:28 [auto1.be] INFO: Saving data for WE56106: {'auction_closing_time': 1774886066.0, 'created_time': 1774524712.791888, 'last_price_update_time': 1774816288.449962}
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE56106') HTTP/1.1" 204 0
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-29 20:31:28 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-29 20:31:28 [auto1.be] INFO: Scrape type for FC28046: 2
2026-03-29 20:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-29 20:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1dadde-b25e-5539-ac33-ae3b015b70af with scrape type 2
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1dadde-b25e-5539-ac33-ae3b015b70af with scrape type 2
2026-03-29 20:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d1dadde-b25e-5539-ac33-ae3b015b70af, identifier: FC28046
2026-03-29 20:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-29 20:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046
2026-03-29 20:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d1dadde-b25e-5539-ac33-ae3b015b70af with identifier: FC28046 to the API
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:41:02Z',
 'fuel_type': 'hybrid',
 'id': '6d1dadde-b25e-5539-ac33-ae3b015b70af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC28046',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 86029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2022}
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-29 20:31:28 [auto1.be] INFO: Saving data for FC28046: {'auction_closing_time': 1774885262.0, 'created_time': 1773520260.666667, 'last_price_update_time': 1774816288.892815}
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28046') HTTP/1.1" 204 0
2026-03-29 20:31:28 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Scrape type for FG88533: 2
2026-03-29 20:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-29 20:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f1f9139-c0d1-5232-a696-a508ce90d715 with scrape type 2
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f1f9139-c0d1-5232-a696-a508ce90d715 with scrape type 2
2026-03-29 20:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f1f9139-c0d1-5232-a696-a508ce90d715, identifier: FG88533
2026-03-29 20:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-29 20:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533
2026-03-29 20:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f1f9139-c0d1-5232-a696-a508ce90d715 with identifier: FG88533 to the API
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:29Z',
 'fuel_type': 'diesel',
 'id': '8f1f9139-c0d1-5232-a696-a508ce90d715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG88533',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 184985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-06',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D3 Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2017}
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Saving data for FG88533: {'auction_closing_time': 1774885889.0, 'created_time': 1773135910.865129, 'last_price_update_time': 1774816289.441285}
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG88533') HTTP/1.1" 204 0
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Scrape type for SR34780: 2
2026-03-29 20:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-29 20:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4722792-8b55-5cbb-9e50-4647aeecf256 with scrape type 2
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4722792-8b55-5cbb-9e50-4647aeecf256 with scrape type 2
2026-03-29 20:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4722792-8b55-5cbb-9e50-4647aeecf256, identifier: SR34780
2026-03-29 20:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-29 20:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780
2026-03-29 20:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4722792-8b55-5cbb-9e50-4647aeecf256 with identifier: SR34780 to the API
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:10:47Z',
 'fuel_type': 'diesel',
 'id': 'f4722792-8b55-5cbb-9e50-4647aeecf256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34780',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 58061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2020}
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-29 20:31:29 [auto1.be] INFO: Saving data for SR34780: {'auction_closing_time': 1774883447.0, 'created_time': 1774254709.273744, 'last_price_update_time': 1774816289.876489}
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR34780') HTTP/1.1" 204 0
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 20:31:29 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [auto1.be] INFO: Scrape type for JX62848: 2
2026-03-29 20:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-29 20:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b09b911-677d-5afc-ad0b-4221d98ef428 with scrape type 2
2026-03-29 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b09b911-677d-5afc-ad0b-4221d98ef428 with scrape type 2
2026-03-29 20:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b09b911-677d-5afc-ad0b-4221d98ef428, identifier: JX62848
2026-03-29 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-29 20:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848
2026-03-29 20:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b09b911-677d-5afc-ad0b-4221d98ef428 with identifier: JX62848 to the API
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:41:01Z',
 'fuel_type': 'diesel',
 'id': '2b09b911-677d-5afc-ad0b-4221d98ef428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX62848',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 129400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi L2 Sport',
 'transmission': 'automatic',
 'trim': 'L2 Sport',
 'year': 2020}
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [auto1.be] INFO: Saving data for JX62848: {'auction_closing_time': 1774885261.0, 'created_time': 1774297878.045573, 'last_price_update_time': 1774816290.416298}
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX62848') HTTP/1.1" 204 0
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 20:31:30 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 20:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:31 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-29 20:31:31 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 20:31:31 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-29 20:31:31 [auto1.be] INFO: Scrape type for RN56335: 2
2026-03-29 20:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-29 20:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa4faba-ccce-55c8-9119-c95e844fbfbe with scrape type 2
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffa4faba-ccce-55c8-9119-c95e844fbfbe with scrape type 2
2026-03-29 20:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ffa4faba-ccce-55c8-9119-c95e844fbfbe, identifier: RN56335
2026-03-29 20:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-29 20:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335
2026-03-29 20:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ffa4faba-ccce-55c8-9119-c95e844fbfbe with identifier: RN56335 to the API
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:41:08Z',
 'fuel_type': 'petrol',
 'id': 'ffa4faba-ccce-55c8-9119-c95e844fbfbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN56335',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 105536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-25',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-29 20:31:31 [auto1.be] INFO: Saving data for RN56335: {'auction_closing_time': 1774885268.0, 'created_time': 1774611062.534552, 'last_price_update_time': 1774816291.991452}
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RN56335') HTTP/1.1" 204 0
2026-03-29 20:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:32 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-29 20:31:32 [auto1.be] INFO: Scrape type for RF80171: 2
2026-03-29 20:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171
2026-03-29 20:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb740380-c5f8-5999-9531-3b7739e0e236 with scrape type 2
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb740380-c5f8-5999-9531-3b7739e0e236 with scrape type 2
2026-03-29 20:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb740380-c5f8-5999-9531-3b7739e0e236, identifier: RF80171
2026-03-29 20:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171
2026-03-29 20:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171
2026-03-29 20:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb740380-c5f8-5999-9531-3b7739e0e236 with identifier: RF80171 to the API
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:52Z',
 'fuel_type': 'petrol',
 'id': 'fb740380-c5f8-5999-9531-3b7739e0e236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF80171',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 110082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-07-05',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.3 1300',
 'transmission': 'manual',
 'trim': '1300',
 'year': 2000}
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-29 20:31:33 [auto1.be] INFO: Saving data for RF80171: {'auction_closing_time': 1774886332.0, 'created_time': 1774038862.293336, 'last_price_update_time': 1774816293.043964}
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF80171') HTTP/1.1" 204 0
2026-03-29 20:31:33 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 20:31:33 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-29 20:31:33 [auto1.be] INFO: Scrape type for DT24627: 2
2026-03-29 20:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-29 20:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with scrape type 2
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with scrape type 2
2026-03-29 20:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9847a40b-2ab2-5564-a7eb-235aebd8ab07, identifier: DT24627
2026-03-29 20:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-29 20:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627
2026-03-29 20:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9847a40b-2ab2-5564-a7eb-235aebd8ab07 with identifier: DT24627 to the API
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:25Z',
 'fuel_type': 'petrol',
 'id': '9847a40b-2ab2-5564-a7eb-235aebd8ab07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT24627',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 150442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-21',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-29 20:31:33 [auto1.be] INFO: Saving data for DT24627: {'auction_closing_time': 1774883965.0, 'created_time': 1773301634.253162, 'last_price_update_time': 1774816293.460064}
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT24627') HTTP/1.1" 204 0
2026-03-29 20:31:33 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 20:31:33 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-29 20:31:33 [auto1.be] INFO: Scrape type for CH83928: 2
2026-03-29 20:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-29 20:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46836ba0-dcc0-5028-a621-e5011f6d3c7b with scrape type 2
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46836ba0-dcc0-5028-a621-e5011f6d3c7b with scrape type 2
2026-03-29 20:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46836ba0-dcc0-5028-a621-e5011f6d3c7b, identifier: CH83928
2026-03-29 20:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 20:31:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-29 20:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928 to the API
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:37:44Z',
 'fuel_type': 'diesel',
 'id': '46836ba0-dcc0-5028-a621-e5011f6d3c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH83928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 165799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2017}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Saving data for CH83928: {'auction_closing_time': 1774885064.0, 'created_time': 1774557029.48714, 'last_price_update_time': 1774816294.100843}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH83928') HTTP/1.1" 204 0
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Scrape type for CP91123: 2
2026-03-29 20:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-29 20:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9137b048-af85-56fa-b073-cf9877a6c6b6 with scrape type 2
2026-03-29 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9137b048-af85-56fa-b073-cf9877a6c6b6 with scrape type 2
2026-03-29 20:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9137b048-af85-56fa-b073-cf9877a6c6b6, identifier: CP91123
2026-03-29 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-29 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123
2026-03-29 20:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9137b048-af85-56fa-b073-cf9877a6c6b6 with identifier: CP91123 to the API
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:37Z',
 'fuel_type': 'petrol',
 'id': '9137b048-af85-56fa-b073-cf9877a6c6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP91123',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 190051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Saving data for CP91123: {'auction_closing_time': 1774884277.0, 'created_time': 1774297998.769522, 'last_price_update_time': 1774816294.616377}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP91123') HTTP/1.1" 204 0
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-29 20:31:34 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [auto1.be] INFO: Scrape type for XD36076: 2
2026-03-29 20:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-29 20:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d84f2b5-e901-529d-956f-4493e0794e65 with scrape type 2
2026-03-29 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d84f2b5-e901-529d-956f-4493e0794e65 with scrape type 2
2026-03-29 20:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d84f2b5-e901-529d-956f-4493e0794e65, identifier: XD36076
2026-03-29 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-29 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-29 20:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076 to the API
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:53Z',
 'fuel_type': 'diesel',
 'id': '6d84f2b5-e901-529d-956f-4493e0794e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD36076',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 170077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Saving data for XD36076: {'auction_closing_time': 1774885013.0, 'created_time': 1773923008.308945, 'last_price_update_time': 1774816295.141833}
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD36076') HTTP/1.1" 204 0
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Scrape type for AL21659: 2
2026-03-29 20:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-29 20:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1c24096-f6d3-501f-a13d-66288782ee38 with scrape type 2
2026-03-29 20:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1c24096-f6d3-501f-a13d-66288782ee38 with scrape type 2
2026-03-29 20:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1c24096-f6d3-501f-a13d-66288782ee38, identifier: AL21659
2026-03-29 20:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-29 20:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659
2026-03-29 20:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1c24096-f6d3-501f-a13d-66288782ee38 with identifier: AL21659 to the API
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:26:09Z',
 'fuel_type': 'petrol',
 'id': 'b1c24096-f6d3-501f-a13d-66288782ee38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL21659',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 130607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-24',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Saving data for AL21659: {'auction_closing_time': 1774884369.0, 'created_time': 1773133726.398531, 'last_price_update_time': 1774816295.591411}
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AL21659') HTTP/1.1" 204 0
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 20:31:35 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-29 20:31:35 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-29 20:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:43 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:43 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-29 20:31:43 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-29 20:31:43 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-29 20:31:43 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-29 20:31:43 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 20:31:43 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-29 20:31:43 [auto1.be] INFO: Scrape type for DY95002: 2
2026-03-29 20:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-29 20:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f06f82-f920-59e5-875b-b7273d1fb069 with scrape type 2
2026-03-29 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78f06f82-f920-59e5-875b-b7273d1fb069 with scrape type 2
2026-03-29 20:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78f06f82-f920-59e5-875b-b7273d1fb069, identifier: DY95002
2026-03-29 20:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-29 20:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-29 20:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002 to the API
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:06Z',
 'fuel_type': 'diesel',
 'id': '78f06f82-f920-59e5-875b-b7273d1fb069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY95002',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 220067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-16',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-29 20:31:43 [auto1.be] INFO: Saving data for DY95002: {'auction_closing_time': 1774885986.0, 'created_time': 1774524731.538607, 'last_price_update_time': 1774816303.671052}
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY95002') HTTP/1.1" 204 0
2026-03-29 20:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:43 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-29 20:31:43 [auto1.be] INFO: Scrape type for HL95749: 2
2026-03-29 20:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-29 20:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with scrape type 2
2026-03-29 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with scrape type 2
2026-03-29 20:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ce52f5ce-1b5d-58ca-9610-cea76740a1b5, identifier: HL95749
2026-03-29 20:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-29 20:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749
2026-03-29 20:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ce52f5ce-1b5d-58ca-9610-cea76740a1b5 with identifier: HL95749 to the API
2026-03-29 20:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:43:16Z',
 'fuel_type': 'diesel',
 'id': 'ce52f5ce-1b5d-58ca-9610-cea76740a1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL95749',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 93933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi 330 L1H2 Komfort HDi 130',
 'transmission': 'manual',
 'trim': '330 L1H2 Komfort HDi 130',
 'year': 2015}
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-29 20:31:44 [auto1.be] INFO: Saving data for HL95749: {'auction_closing_time': 1774885396.0, 'created_time': 1774265466.227732, 'last_price_update_time': 1774816304.165652}
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL95749') HTTP/1.1" 204 0
2026-03-29 20:31:44 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-29 20:31:44 [auto1.be] INFO: Scrape type for SA79242: 2
2026-03-29 20:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-29 20:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with scrape type 2
2026-03-29 20:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with scrape type 2
2026-03-29 20:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620, identifier: SA79242
2026-03-29 20:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-29 20:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242
2026-03-29 20:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bbe2ea34-26d2-58c8-b5f3-766ff7ec7620 with identifier: SA79242 to the API
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:25:09Z',
 'fuel_type': 'petrol',
 'id': 'bbe2ea34-26d2-58c8-b5f3-766ff7ec7620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79242',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 197674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2011}
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-29 20:31:44 [auto1.be] INFO: Saving data for SA79242: {'auction_closing_time': 1774884309.0, 'created_time': 1773237244.209865, 'last_price_update_time': 1774816304.597736}
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA79242') HTTP/1.1" 204 0
2026-03-29 20:31:44 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 20:31:44 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-29 20:31:44 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-29 20:31:44 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 20:31:44 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-29 20:31:44 [auto1.be] INFO: Scrape type for CE58685: 2
2026-03-29 20:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-29 20:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with scrape type 2
2026-03-29 20:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with scrape type 2
2026-03-29 20:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eb2f681d-d203-57e2-8f7d-18af5a0d45c2, identifier: CE58685
2026-03-29 20:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-29 20:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-29 20:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685 to the API
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:36:13Z',
 'fuel_type': 'petrol',
 'id': 'eb2f681d-d203-57e2-8f7d-18af5a0d45c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE58685',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 153262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Racer',
 'transmission': 'manual',
 'trim': 'Racer',
 'year': 2016}
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-29 20:31:45 [auto1.be] INFO: Saving data for CE58685: {'auction_closing_time': 1774884973.0, 'created_time': 1773434068.87953, 'last_price_update_time': 1774816305.02278}
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE58685') HTTP/1.1" 204 0
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-29 20:31:45 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-29 20:31:45 [auto1.be] INFO: Scrape type for GN45273: 2
2026-03-29 20:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273
2026-03-29 20:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with scrape type 2
2026-03-29 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with scrape type 2
2026-03-29 20:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827, identifier: GN45273
2026-03-29 20:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273
2026-03-29 20:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273
2026-03-29 20:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827 with identifier: GN45273 to the API
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:04:51Z',
 'fuel_type': 'diesel',
 'id': 'b7c94754-d48b-5dc1-8cfb-b3d9cdcfc827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN45273',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 180175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-29 20:31:45 [auto1.be] INFO: Saving data for GN45273: {'auction_closing_time': 1774883091.0, 'created_time': 1774513859.61091, 'last_price_update_time': 1774816305.504834}
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN45273') HTTP/1.1" 204 0
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 20:31:45 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-29 20:31:45 [auto1.be] INFO: Scrape type for AE23838: 2
2026-03-29 20:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-29 20:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with scrape type 2
2026-03-29 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with scrape type 2
2026-03-29 20:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7, identifier: AE23838
2026-03-29 20:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-29 20:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838
2026-03-29 20:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7 with identifier: AE23838 to the API
2026-03-29 20:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:57Z',
 'fuel_type': 'petrol',
 'id': 'fc560f91-c7b9-5323-a1a4-e4b6a3f29ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE23838',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 168072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2019}
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-29 20:31:46 [auto1.be] INFO: Saving data for AE23838: {'auction_closing_time': 1774882917.0, 'created_time': 1773233800.359867, 'last_price_update_time': 1774816306.115097}
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE23838') HTTP/1.1" 204 0
2026-03-29 20:31:46 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-29 20:31:46 [auto1.be] INFO: Scrape type for MF96479: 2
2026-03-29 20:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-29 20:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with scrape type 2
2026-03-29 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with scrape type 2
2026-03-29 20:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c6c0b4d-256b-588f-9919-5a2e28640ae5, identifier: MF96479
2026-03-29 20:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-29 20:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479
2026-03-29 20:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c6c0b4d-256b-588f-9919-5a2e28640ae5 with identifier: MF96479 to the API
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:11Z',
 'fuel_type': 'diesel',
 'id': '2c6c0b4d-256b-588f-9919-5a2e28640ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF96479',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 153674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-02',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-29 20:31:46 [auto1.be] INFO: Saving data for MF96479: {'auction_closing_time': 1774883291.0, 'created_time': 1773909040.513067, 'last_price_update_time': 1774816306.539681}
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MF96479') HTTP/1.1" 204 0
2026-03-29 20:31:46 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-29 20:31:46 [auto1.be] INFO: Scrape type for WD60187: 2
2026-03-29 20:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-29 20:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d20b14f-7890-5077-89b1-e5edd3895e73 with scrape type 2
2026-03-29 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d20b14f-7890-5077-89b1-e5edd3895e73 with scrape type 2
2026-03-29 20:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d20b14f-7890-5077-89b1-e5edd3895e73, identifier: WD60187
2026-03-29 20:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-29 20:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187
2026-03-29 20:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d20b14f-7890-5077-89b1-e5edd3895e73 with identifier: WD60187 to the API
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:26:18Z',
 'fuel_type': 'diesel',
 'id': '6d20b14f-7890-5077-89b1-e5edd3895e73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD60187',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 269111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2014}
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-29 20:31:46 [auto1.be] INFO: Saving data for WD60187: {'auction_closing_time': 1774884378.0, 'created_time': 1773301772.752533, 'last_price_update_time': 1774816306.964441}
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD60187') HTTP/1.1" 204 0
2026-03-29 20:31:46 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-29 20:31:46 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-29 20:31:46 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for GP69185: 2
2026-03-29 20:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-29 20:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with scrape type 2
2026-03-29 20:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with scrape type 2
2026-03-29 20:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb183f3c-d53b-51e0-9c08-f157fd80d1c9, identifier: GP69185
2026-03-29 20:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-29 20:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185
2026-03-29 20:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb183f3c-d53b-51e0-9c08-f157fd80d1c9 with identifier: GP69185 to the API
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:42:05Z',
 'fuel_type': 'diesel',
 'id': 'bb183f3c-d53b-51e0-9c08-f157fd80d1c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP69185',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 46569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Saving data for GP69185: {'auction_closing_time': 1774885325.0, 'created_time': 1773520255.384527, 'last_price_update_time': 1774816307.431924}
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GP69185') HTTP/1.1" 204 0
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for CN47453: 2
2026-03-29 20:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-29 20:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with scrape type 2
2026-03-29 20:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with scrape type 2
2026-03-29 20:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f, identifier: CN47453
2026-03-29 20:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-29 20:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-29 20:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453 to the API
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:37:15Z',
 'fuel_type': 'diesel',
 'id': 'a86a3ac9-a42d-5c78-8c29-4ae09a1de77f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN47453',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 273890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Saving data for CN47453: {'auction_closing_time': 1774885035.0, 'created_time': 1774524725.193731, 'last_price_update_time': 1774816307.827723}
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN47453') HTTP/1.1" 204 0
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-29 20:31:47 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-29 20:31:47 [auto1.be] INFO: Scrape type for ZR23499: 2
2026-03-29 20:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-29 20:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with scrape type 2
2026-03-29 20:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with scrape type 2
2026-03-29 20:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891, identifier: ZR23499
2026-03-29 20:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-29 20:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499
2026-03-29 20:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 071b5eaa-f305-5ec8-a4d5-e838f8b5b891 with identifier: ZR23499 to the API
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:13:42Z',
 'fuel_type': 'diesel',
 'id': '071b5eaa-f305-5ec8-a4d5-e838f8b5b891',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR23499',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 179022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-15',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-29 20:31:48 [auto1.be] INFO: Saving data for ZR23499: {'auction_closing_time': 1774883622.0, 'created_time': 1773520266.075254, 'last_price_update_time': 1774816308.366958}
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR23499') HTTP/1.1" 204 0
2026-03-29 20:31:48 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 20:31:48 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 20:31:48 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 20:31:48 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-29 20:31:48 [auto1.be] INFO: Scrape type for ZR56949: 2
2026-03-29 20:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-29 20:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with scrape type 2
2026-03-29 20:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with scrape type 2
2026-03-29 20:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430, identifier: ZR56949
2026-03-29 20:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-29 20:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949
2026-03-29 20:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e3d8b2f-0b45-5bac-8370-2e8accb5a430 with identifier: ZR56949 to the API
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:15:07Z',
 'fuel_type': 'diesel',
 'id': '0e3d8b2f-0b45-5bac-8370-2e8accb5a430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR56949',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 157227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2021}
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-29 20:31:48 [auto1.be] INFO: Saving data for ZR56949: {'auction_closing_time': 1774883707.0, 'created_time': 1773132593.343894, 'last_price_update_time': 1774816308.784034}
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR56949') HTTP/1.1" 204 0
2026-03-29 20:31:48 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-29 20:31:48 [auto1.be] INFO: Scrape type for MA06269: 2
2026-03-29 20:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-29 20:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8844e-4c0a-5673-8d2a-4ca96307810d with scrape type 2
2026-03-29 20:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a8844e-4c0a-5673-8d2a-4ca96307810d with scrape type 2
2026-03-29 20:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1a8844e-4c0a-5673-8d2a-4ca96307810d, identifier: MA06269
2026-03-29 20:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-29 20:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-29 20:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269 to the API
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:38:42Z',
 'fuel_type': 'diesel',
 'id': 'a1a8844e-4c0a-5673-8d2a-4ca96307810d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA06269',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 157026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2016}
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Saving data for MA06269: {'auction_closing_time': 1774885122.0, 'created_time': 1774524675.546347, 'last_price_update_time': 1774816309.176298}
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA06269') HTTP/1.1" 204 0
2026-03-29 20:31:49 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Scrape type for YU72813: 2
2026-03-29 20:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-29 20:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a76ec79-767d-54a2-9645-fc632314dab7 with scrape type 2
2026-03-29 20:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a76ec79-767d-54a2-9645-fc632314dab7 with scrape type 2
2026-03-29 20:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a76ec79-767d-54a2-9645-fc632314dab7, identifier: YU72813
2026-03-29 20:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-29 20:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-29 20:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813 to the API
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:53:21Z',
 'fuel_type': 'diesel',
 'id': '0a76ec79-767d-54a2-9645-fc632314dab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU72813',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 187635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-10',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2018}
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Saving data for YU72813: {'auction_closing_time': 1774886001.0, 'created_time': 1774643479.7543, 'last_price_update_time': 1774816309.591334}
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU72813') HTTP/1.1" 204 0
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-29 20:31:49 [auto1.be] INFO: Scrape type for LE55631: 2
2026-03-29 20:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-29 20:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013032f-390a-5eea-966f-854d34707c70 with scrape type 2
2026-03-29 20:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8013032f-390a-5eea-966f-854d34707c70 with scrape type 2
2026-03-29 20:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8013032f-390a-5eea-966f-854d34707c70, identifier: LE55631
2026-03-29 20:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 20:31:49 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 20:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-29 20:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631
2026-03-29 20:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8013032f-390a-5eea-966f-854d34707c70 with identifier: LE55631 to the API
2026-03-29 20:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:02:00Z',
 'fuel_type': 'petrol',
 'id': '8013032f-390a-5eea-966f-854d34707c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE55631',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 98347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-29 20:31:50 [auto1.be] INFO: Saving data for LE55631: {'auction_closing_time': 1774882920.0, 'created_time': 1774611069.779502, 'last_price_update_time': 1774816310.134888}
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE55631') HTTP/1.1" 204 0
2026-03-29 20:31:50 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 20:31:50 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 20:31:50 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-29 20:31:50 [auto1.be] INFO: Scrape type for KF52558: 2
2026-03-29 20:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-29 20:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eccde05-fbe7-5db7-949b-a124dff01c9f with scrape type 2
2026-03-29 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eccde05-fbe7-5db7-949b-a124dff01c9f with scrape type 2
2026-03-29 20:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7eccde05-fbe7-5db7-949b-a124dff01c9f, identifier: KF52558
2026-03-29 20:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-29 20:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558
2026-03-29 20:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7eccde05-fbe7-5db7-949b-a124dff01c9f with identifier: KF52558 to the API
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:24:00Z',
 'fuel_type': 'petrol',
 'id': '7eccde05-fbe7-5db7-949b-a124dff01c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF52558',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 171979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-29 20:31:50 [auto1.be] INFO: Saving data for KF52558: {'auction_closing_time': 1774884240.0, 'created_time': 1773923068.671579, 'last_price_update_time': 1774816310.542124}
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF52558') HTTP/1.1" 204 0
2026-03-29 20:31:50 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-29 20:31:50 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-29 20:31:50 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-29 20:31:50 [auto1.be] INFO: Scrape type for TW64249: 2
2026-03-29 20:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-29 20:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a35451-5ed2-59ee-991e-149c10f05330 with scrape type 2
2026-03-29 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8a35451-5ed2-59ee-991e-149c10f05330 with scrape type 2
2026-03-29 20:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8a35451-5ed2-59ee-991e-149c10f05330, identifier: TW64249
2026-03-29 20:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-29 20:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-29 20:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249 to the API
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:47:14Z',
 'fuel_type': 'petrol',
 'id': 'c8a35451-5ed2-59ee-991e-149c10f05330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW64249',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 56804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 2WD',
 'transmission': 'manual',
 'trim': '2WD',
 'year': 2019}
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-29 20:31:51 [auto1.be] INFO: Saving data for TW64249: {'auction_closing_time': 1774885634.0, 'created_time': 1774524735.748753, 'last_price_update_time': 1774816311.027923}
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW64249') HTTP/1.1" 204 0
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-29 20:31:51 [auto1.be] INFO: Scrape type for PY81659: 2
2026-03-29 20:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-29 20:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9597f0e3-fcf9-509d-88fa-2507f6954810 with scrape type 2
2026-03-29 20:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9597f0e3-fcf9-509d-88fa-2507f6954810 with scrape type 2
2026-03-29 20:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9597f0e3-fcf9-509d-88fa-2507f6954810, identifier: PY81659
2026-03-29 20:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-29 20:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-29 20:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659 to the API
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'diesel',
 'id': '9597f0e3-fcf9-509d-88fa-2507f6954810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY81659',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-29 20:31:51 [auto1.be] INFO: Saving data for PY81659: {'auction_closing_time': 1774882938.0, 'created_time': 1774557060.829321, 'last_price_update_time': 1774816311.452172}
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY81659') HTTP/1.1" 204 0
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-29 20:31:51 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-29 20:31:51 [auto1.be] INFO: Scrape type for WK14396: 2
2026-03-29 20:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-29 20:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with scrape type 2
2026-03-29 20:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with scrape type 2
2026-03-29 20:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8, identifier: WK14396
2026-03-29 20:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-29 20:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396
2026-03-29 20:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8 with identifier: WK14396 to the API
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'petrol',
 'id': 'bf5ed9a8-8aa2-5266-88a2-78cdae05b8e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK14396',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 153623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-27',
 'seller_name': None,
 'title': 'Volvo C30 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-29 20:31:51 [auto1.be] INFO: Saving data for WK14396: {'auction_closing_time': 1774883765.0, 'created_time': 1774298097.842679, 'last_price_update_time': 1774816311.871387}
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK14396') HTTP/1.1" 204 0
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 20:31:51 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Scrape type for RW49064: 2
2026-03-29 20:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-29 20:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb20124-c7a5-5eb9-aeb0-897e67763536 with scrape type 2
2026-03-29 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb20124-c7a5-5eb9-aeb0-897e67763536 with scrape type 2
2026-03-29 20:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bb20124-c7a5-5eb9-aeb0-897e67763536, identifier: RW49064
2026-03-29 20:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-29 20:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-29 20:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064 to the API
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:48:59Z',
 'fuel_type': 'diesel',
 'id': '0bb20124-c7a5-5eb9-aeb0-897e67763536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW49064',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 191150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2018}
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Saving data for RW49064: {'auction_closing_time': 1774885739.0, 'created_time': 1774524698.63406, 'last_price_update_time': 1774816312.364769}
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW49064') HTTP/1.1" 204 0
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Scrape type for CS98471: 2
2026-03-29 20:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-29 20:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with scrape type 2
2026-03-29 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with scrape type 2
2026-03-29 20:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025, identifier: CS98471
2026-03-29 20:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-29 20:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-29 20:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471 to the API
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:15:22Z',
 'fuel_type': 'petrol',
 'id': '485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS98471',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 126726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.3 DIG-T Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2019}
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Saving data for CS98471: {'auction_closing_time': 1774883722.0, 'created_time': 1774643495.833765, 'last_price_update_time': 1774816312.791784}
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS98471') HTTP/1.1" 204 0
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Scrape type for KC69840: 0
2026-03-29 20:31:52 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-29 20:31:52 [auto1.be] INFO: Scrape type for ZR84759: 2
2026-03-29 20:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-29 20:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with scrape type 2
2026-03-29 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with scrape type 2
2026-03-29 20:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 06168cd0-ba08-5fa9-92ab-50b6e7211c24, identifier: ZR84759
2026-03-29 20:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-29 20:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759
2026-03-29 20:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 06168cd0-ba08-5fa9-92ab-50b6e7211c24 with identifier: ZR84759 to the API
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:13Z',
 'fuel_type': 'petrol',
 'id': '06168cd0-ba08-5fa9-92ab-50b6e7211c24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR84759',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 140203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-15',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.8 LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2011}
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-29 20:31:53 [auto1.be] INFO: Saving data for ZR84759: {'auction_closing_time': 1774883233.0, 'created_time': 1773225539.157312, 'last_price_update_time': 1774816313.230084}
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR84759') HTTP/1.1" 204 0
2026-03-29 20:31:53 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-29 20:31:53 [auto1.be] INFO: Scrape type for WG89987: 2
2026-03-29 20:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-29 20:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64082240-6a27-58e4-8a93-93be97e7a50e with scrape type 2
2026-03-29 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64082240-6a27-58e4-8a93-93be97e7a50e with scrape type 2
2026-03-29 20:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64082240-6a27-58e4-8a93-93be97e7a50e, identifier: WG89987
2026-03-29 20:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-29 20:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987
2026-03-29 20:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64082240-6a27-58e4-8a93-93be97e7a50e with identifier: WG89987 to the API
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:59:40Z',
 'fuel_type': 'diesel',
 'id': '64082240-6a27-58e4-8a93-93be97e7a50e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG89987',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 221145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-29 20:31:53 [auto1.be] INFO: Saving data for WG89987: {'auction_closing_time': 1774886380.0, 'created_time': 1774611037.863469, 'last_price_update_time': 1774816313.713478}
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG89987') HTTP/1.1" 204 0
2026-03-29 20:31:53 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 20:31:53 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 20:31:53 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-29 20:31:53 [auto1.be] INFO: Scrape type for WC98842: 2
2026-03-29 20:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-29 20:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with scrape type 2
2026-03-29 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with scrape type 2
2026-03-29 20:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66750d3f-3e98-520f-bcd4-52bf5c7783d7, identifier: WC98842
2026-03-29 20:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-29 20:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842
2026-03-29 20:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66750d3f-3e98-520f-bcd4-52bf5c7783d7 with identifier: WC98842 to the API
2026-03-29 20:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:01Z',
 'fuel_type': 'petrol',
 'id': '66750d3f-3e98-520f-bcd4-52bf5c7783d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC98842',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 118075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Saving data for WC98842: {'auction_closing_time': 1774885921.0, 'created_time': 1774611132.2031, 'last_price_update_time': 1774816314.141896}
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC98842') HTTP/1.1" 204 0
2026-03-29 20:31:54 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1260 | hits on page: 40
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Scrape type for UJ89543: 2
2026-03-29 20:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-29 20:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with scrape type 2
2026-03-29 20:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with scrape type 2
2026-03-29 20:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f, identifier: UJ89543
2026-03-29 20:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 20:31:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543
2026-03-29 20:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba49b4c3-f8dc-57dd-9b37-0930265f7d1f with identifier: UJ89543 to the API
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:19Z',
 'fuel_type': 'diesel',
 'id': 'ba49b4c3-f8dc-57dd-9b37-0930265f7d1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ89543',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 142972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-04',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Adventure',
 'transmission': 'manual',
 'trim': 'Adventure',
 'year': 2014}
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Saving data for UJ89543: {'auction_closing_time': 1774882819.0, 'created_time': 1773909041.330022, 'last_price_update_time': 1774816314.845327}
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ89543') HTTP/1.1" 204 0
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Scrape type for JZ97752: 2
2026-03-29 20:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752
2026-03-29 20:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8252f8-9f3b-5247-944c-414b3e47d28d with scrape type 2
2026-03-29 20:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba8252f8-9f3b-5247-944c-414b3e47d28d with scrape type 2
2026-03-29 20:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba8252f8-9f3b-5247-944c-414b3e47d28d, identifier: JZ97752
2026-03-29 20:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:54 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-29 20:31:54 [auto1.be] INFO: Scrape type for SZ60181: 2
2026-03-29 20:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-29 20:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with scrape type 2
2026-03-29 20:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with scrape type 2
2026-03-29 20:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d, identifier: SZ60181
2026-03-29 20:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752
2026-03-29 20:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752
2026-03-29 20:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752 to the API
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:52Z',
 'fuel_type': 'petrol',
 'id': 'ba8252f8-9f3b-5247-944c-414b3e47d28d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ97752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 65118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-29 20:31:55 [auto1.be] INFO: Saving data for JZ97752: {'auction_closing_time': 1774882912.0, 'created_time': 1774729910.810096, 'last_price_update_time': 1774816315.343735}
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ97752') HTTP/1.1" 204 0
2026-03-29 20:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-29 20:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181
2026-03-29 20:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d with identifier: SZ60181 to the API
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:10:17Z',
 'fuel_type': 'diesel',
 'id': '7a4ab7a7-6bc6-5f78-9cdf-9a844d9b226d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ60181',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 137341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-29 20:31:55 [auto1.be] INFO: Saving data for SZ60181: {'auction_closing_time': 1774883417.0, 'created_time': 1774611051.594755, 'last_price_update_time': 1774816315.698802}
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ60181') HTTP/1.1" 204 0
2026-03-29 20:31:55 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 20:31:55 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-29 20:31:55 [auto1.be] INFO: Scrape type for SF38570: 2
2026-03-29 20:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-29 20:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bfc384-0b14-5585-a127-339def39987c with scrape type 2
2026-03-29 20:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46bfc384-0b14-5585-a127-339def39987c with scrape type 2
2026-03-29 20:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46bfc384-0b14-5585-a127-339def39987c, identifier: SF38570
2026-03-29 20:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-29 20:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-29 20:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570 to the API
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:35Z',
 'fuel_type': 'diesel',
 'id': '46bfc384-0b14-5585-a127-339def39987c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF38570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 196004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-29 20:31:56 [auto1.be] INFO: Saving data for SF38570: {'auction_closing_time': 1774883675.0, 'created_time': 1774524728.099755, 'last_price_update_time': 1774816316.083307}
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF38570') HTTP/1.1" 204 0
2026-03-29 20:31:56 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-29 20:31:56 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-29 20:31:56 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 20:31:56 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 20:31:56 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-29 20:31:56 [auto1.be] INFO: Scrape type for MS23670: 2
2026-03-29 20:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-29 20:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with scrape type 2
2026-03-29 20:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with scrape type 2
2026-03-29 20:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e4dbaf1-f583-5eb7-8003-503b2df93d53, identifier: MS23670
2026-03-29 20:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-29 20:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670
2026-03-29 20:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e4dbaf1-f583-5eb7-8003-503b2df93d53 with identifier: MS23670 to the API
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:35:41Z',
 'fuel_type': 'diesel',
 'id': '7e4dbaf1-f583-5eb7-8003-503b2df93d53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS23670',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 243700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-19',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi TD Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-29 20:31:56 [auto1.be] INFO: Saving data for MS23670: {'auction_closing_time': 1774884941.0, 'created_time': 1774611101.485819, 'last_price_update_time': 1774816316.528444}
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS23670') HTTP/1.1" 204 0
2026-03-29 20:31:56 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-29 20:31:56 [auto1.be] INFO: Scrape type for CU40853: 2
2026-03-29 20:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-29 20:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with scrape type 2
2026-03-29 20:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with scrape type 2
2026-03-29 20:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6, identifier: CU40853
2026-03-29 20:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-29 20:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853
2026-03-29 20:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0c41ed0-9f3f-51bc-98be-62ba5f38d0a6 with identifier: CU40853 to the API
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:22:37Z',
 'fuel_type': 'diesel',
 'id': 'd0c41ed0-9f3f-51bc-98be-62ba5f38d0a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU40853',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-29 20:31:57 [auto1.be] INFO: Saving data for CU40853: {'auction_closing_time': 1774884157.0, 'created_time': 1774611052.627411, 'last_price_update_time': 1774816317.074425}
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU40853') HTTP/1.1" 204 0
2026-03-29 20:31:57 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 20:31:57 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-29 20:31:57 [auto1.be] INFO: Scrape type for PR31064: 2
2026-03-29 20:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-29 20:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with scrape type 2
2026-03-29 20:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with scrape type 2
2026-03-29 20:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b736c1b1-d83d-5a21-a86f-e1d912abd4a3, identifier: PR31064
2026-03-29 20:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-29 20:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-29 20:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064 to the API
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:36:01Z',
 'fuel_type': 'diesel',
 'id': 'b736c1b1-d83d-5a21-a86f-e1d912abd4a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR31064',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 148947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-04',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-29 20:31:57 [auto1.be] INFO: Saving data for PR31064: {'auction_closing_time': 1774884961.0, 'created_time': 1773865879.429227, 'last_price_update_time': 1774816317.478569}
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR31064') HTTP/1.1" 204 0
2026-03-29 20:31:57 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 20:31:57 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-29 20:31:57 [auto1.be] INFO: Scrape type for CE65833: 2
2026-03-29 20:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-29 20:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with scrape type 2
2026-03-29 20:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with scrape type 2
2026-03-29 20:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f, identifier: CE65833
2026-03-29 20:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-29 20:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833
2026-03-29 20:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f with identifier: CE65833 to the API
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:50:12Z',
 'fuel_type': 'petrol',
 'id': 'a52c9d91-b791-5ebe-bb0d-bbe5f02b0e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE65833',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 218199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV Motion 4WD',
 'transmission': 'automatic',
 'trim': 'Motion 4WD',
 'year': 2015}
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-29 20:31:57 [auto1.be] INFO: Saving data for CE65833: {'auction_closing_time': 1774885812.0, 'created_time': 1774611096.059278, 'last_price_update_time': 1774816317.896788}
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE65833') HTTP/1.1" 204 0
2026-03-29 20:31:57 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-29 20:31:57 [auto1.be] INFO: Scrape type for VA87646: 2
2026-03-29 20:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646
2026-03-29 20:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c91631-8280-54df-b14a-ddae458034fa with scrape type 2
2026-03-29 20:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c91631-8280-54df-b14a-ddae458034fa with scrape type 2
2026-03-29 20:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75c91631-8280-54df-b14a-ddae458034fa, identifier: VA87646
2026-03-29 20:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646
2026-03-29 20:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646
2026-03-29 20:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75c91631-8280-54df-b14a-ddae458034fa with identifier: VA87646 to the API
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:52:59Z',
 'fuel_type': 'petrol',
 'id': '75c91631-8280-54df-b14a-ddae458034fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA87646',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 87119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-04',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Saving data for VA87646: {'auction_closing_time': 1774885979.0, 'created_time': 1774513856.710235, 'last_price_update_time': 1774816318.356563}
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA87646') HTTP/1.1" 204 0
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Scrape type for JM27578: 2
2026-03-29 20:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578
2026-03-29 20:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f966b3-3618-5eb1-88ca-8d030aafe5bc with scrape type 2
2026-03-29 20:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f966b3-3618-5eb1-88ca-8d030aafe5bc with scrape type 2
2026-03-29 20:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3f966b3-3618-5eb1-88ca-8d030aafe5bc, identifier: JM27578
2026-03-29 20:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578
2026-03-29 20:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578
2026-03-29 20:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3f966b3-3618-5eb1-88ca-8d030aafe5bc with identifier: JM27578 to the API
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:58:20Z',
 'fuel_type': 'diesel',
 'id': 'a3f966b3-3618-5eb1-88ca-8d030aafe5bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM27578',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 229998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Family',
 'transmission': 'automatic',
 'trim': 'L1 Family',
 'year': 2022}
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-29 20:31:58 [auto1.be] INFO: Saving data for JM27578: {'auction_closing_time': 1774886300.0, 'created_time': 1774513838.700189, 'last_price_update_time': 1774816318.867354}
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM27578') HTTP/1.1" 204 0
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 20:31:58 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for VP90118: 2
2026-03-29 20:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-29 20:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804ce7e0-f7ca-5ca5-886f-e36716f80878 with scrape type 2
2026-03-29 20:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 804ce7e0-f7ca-5ca5-886f-e36716f80878 with scrape type 2
2026-03-29 20:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 804ce7e0-f7ca-5ca5-886f-e36716f80878, identifier: VP90118
2026-03-29 20:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-29 20:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118
2026-03-29 20:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 804ce7e0-f7ca-5ca5-886f-e36716f80878 with identifier: VP90118 to the API
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:27Z',
 'fuel_type': 'petrol',
 'id': '804ce7e0-f7ca-5ca5-886f-e36716f80878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP90118',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 72102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-21',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Saving data for VP90118: {'auction_closing_time': 1774884447.0, 'created_time': 1774611032.761359, 'last_price_update_time': 1774816319.449015}
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP90118') HTTP/1.1" 204 0
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for TK06008: 2
2026-03-29 20:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-29 20:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7997474e-e482-5f20-a74c-54252a5a6170 with scrape type 2
2026-03-29 20:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7997474e-e482-5f20-a74c-54252a5a6170 with scrape type 2
2026-03-29 20:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7997474e-e482-5f20-a74c-54252a5a6170, identifier: TK06008
2026-03-29 20:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-29 20:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-29 20:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008 to the API
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:42:57Z',
 'fuel_type': 'petrol',
 'id': '7997474e-e482-5f20-a74c-54252a5a6170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK06008',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 58001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Saving data for TK06008: {'auction_closing_time': 1774885377.0, 'created_time': 1774524708.334329, 'last_price_update_time': 1774816319.848609}
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK06008') HTTP/1.1" 204 0
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 20:31:59 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-29 20:31:59 [auto1.be] INFO: Scrape type for NM63028: 2
2026-03-29 20:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-29 20:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with scrape type 2
2026-03-29 20:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with scrape type 2
2026-03-29 20:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1, identifier: NM63028
2026-03-29 20:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-29 20:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028
2026-03-29 20:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e12bef2-c3f5-5cd9-ab84-9081692f87e1 with identifier: NM63028 to the API
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:58:40Z',
 'fuel_type': 'petrol',
 'id': '7e12bef2-c3f5-5cd9-ab84-9081692f87e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM63028',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 129173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-17',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 L1 Komfort Plus',
 'transmission': 'manual',
 'trim': 'L1 Komfort Plus',
 'year': 2016}
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Saving data for NM63028: {'auction_closing_time': 1774886320.0, 'created_time': 1774611126.817051, 'last_price_update_time': 1774816320.294601}
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM63028') HTTP/1.1" 204 0
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for FA63464: 2
2026-03-29 20:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-29 20:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55df2ce-ceec-5a04-8351-8bfe516065a5 with scrape type 2
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55df2ce-ceec-5a04-8351-8bfe516065a5 with scrape type 2
2026-03-29 20:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d55df2ce-ceec-5a04-8351-8bfe516065a5, identifier: FA63464
2026-03-29 20:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-29 20:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464
2026-03-29 20:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d55df2ce-ceec-5a04-8351-8bfe516065a5 with identifier: FA63464 to the API
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:00:11Z',
 'fuel_type': 'diesel',
 'id': 'd55df2ce-ceec-5a04-8351-8bfe516065a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA63464',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 252739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Saving data for FA63464: {'auction_closing_time': 1774882811.0, 'created_time': 1774611052.962473, 'last_price_update_time': 1774816320.811471}
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA63464') HTTP/1.1" 204 0
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-29 20:32:00 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:00 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [auto1.be] INFO: Scrape type for MC66522: 2
2026-03-29 20:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-29 20:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392a769e-bb78-5699-a29f-f5922d2d40b0 with scrape type 2
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 392a769e-bb78-5699-a29f-f5922d2d40b0 with scrape type 2
2026-03-29 20:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 392a769e-bb78-5699-a29f-f5922d2d40b0, identifier: MC66522
2026-03-29 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-29 20:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522
2026-03-29 20:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 392a769e-bb78-5699-a29f-f5922d2d40b0 with identifier: MC66522 to the API
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:50:21Z',
 'fuel_type': 'diesel',
 'id': '392a769e-bb78-5699-a29f-f5922d2d40b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC66522',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 143399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-18',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Comfort Blue 2WD',
 'transmission': 'manual',
 'trim': 'Comfort Blue 2WD',
 'year': 2012}
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [auto1.be] INFO: Saving data for MC66522: {'auction_closing_time': 1774885821.0, 'created_time': 1774611065.508958, 'last_price_update_time': 1774816321.302621}
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC66522') HTTP/1.1" 204 0
2026-03-29 20:32:01 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [auto1.be] INFO: Scrape type for ZK00678: 2
2026-03-29 20:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-29 20:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with scrape type 2
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with scrape type 2
2026-03-29 20:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa, identifier: ZK00678
2026-03-29 20:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-29 20:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678
2026-03-29 20:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 569eba0d-a06b-53bf-b4bc-4c5b5891dffa with identifier: ZK00678 to the API
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:19:41Z',
 'fuel_type': 'diesel',
 'id': '569eba0d-a06b-53bf-b4bc-4c5b5891dffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK00678',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 148171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [auto1.be] INFO: Saving data for ZK00678: {'auction_closing_time': 1774883981.0, 'created_time': 1774611053.857631, 'last_price_update_time': 1774816321.813364}
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK00678') HTTP/1.1" 204 0
2026-03-29 20:32:01 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 20:32:01 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [auto1.be] INFO: Scrape type for HH62001: 2
2026-03-29 20:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-29 20:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e159aa-dfa3-546b-af2c-2d385f022ff5 with scrape type 2
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e159aa-dfa3-546b-af2c-2d385f022ff5 with scrape type 2
2026-03-29 20:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41e159aa-dfa3-546b-af2c-2d385f022ff5, identifier: HH62001
2026-03-29 20:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-29 20:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-29 20:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001 to the API
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:06:06Z',
 'fuel_type': 'petrol',
 'id': '41e159aa-dfa3-546b-af2c-2d385f022ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH62001',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 138606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2007}
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Saving data for HH62001: {'auction_closing_time': 1774883166.0, 'created_time': 1774524718.953296, 'last_price_update_time': 1774816322.185107}
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH62001') HTTP/1.1" 204 0
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Scrape type for WF76478: 2
2026-03-29 20:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-29 20:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with scrape type 2
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with scrape type 2
2026-03-29 20:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0ab1be6-e265-5fb1-9dbe-7ece245189a2, identifier: WF76478
2026-03-29 20:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-29 20:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478
2026-03-29 20:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0ab1be6-e265-5fb1-9dbe-7ece245189a2 with identifier: WF76478 to the API
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:59Z',
 'fuel_type': 'diesel',
 'id': 'c0ab1be6-e265-5fb1-9dbe-7ece245189a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF76478',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60 Cross Country',
 'odometer': 34223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'Volvo S60 Cross Country 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2016}
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Saving data for WF76478: {'auction_closing_time': 1774886339.0, 'created_time': 1774298004.937259, 'last_price_update_time': 1774816322.605005}
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WF76478') HTTP/1.1" 204 0
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-29 20:32:02 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [auto1.be] INFO: Scrape type for JS25395: 2
2026-03-29 20:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-29 20:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c098b5-b634-51ba-b646-fa3203c26975 with scrape type 2
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c098b5-b634-51ba-b646-fa3203c26975 with scrape type 2
2026-03-29 20:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96c098b5-b634-51ba-b646-fa3203c26975, identifier: JS25395
2026-03-29 20:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-29 20:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-29 20:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395 to the API
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:10Z',
 'fuel_type': 'diesel',
 'id': '96c098b5-b634-51ba-b646-fa3203c26975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS25395',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 91291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Saving data for JS25395: {'auction_closing_time': 1774885510.0, 'created_time': 1774524684.154196, 'last_price_update_time': 1774816323.061588}
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS25395') HTTP/1.1" 204 0
2026-03-29 20:32:03 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-29 20:32:03 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Scrape type for GA09150: 2
2026-03-29 20:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-29 20:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with scrape type 2
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with scrape type 2
2026-03-29 20:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474, identifier: GA09150
2026-03-29 20:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-29 20:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-29 20:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150 to the API
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:17:19Z',
 'fuel_type': 'diesel',
 'id': 'dcabeb84-ec6b-53b7-bcc8-18dd3bc04474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA09150',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 183696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'BMW 3er 325d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Saving data for GA09150: {'auction_closing_time': 1774883839.0, 'created_time': 1774524690.959677, 'last_price_update_time': 1774816323.522184}
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA09150') HTTP/1.1" 204 0
2026-03-29 20:32:03 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 20:32:03 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Scrape type for FY43318: 2
2026-03-29 20:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-29 20:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cca6974-2926-5b82-9783-98b83b9e5a21 with scrape type 2
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cca6974-2926-5b82-9783-98b83b9e5a21 with scrape type 2
2026-03-29 20:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0cca6974-2926-5b82-9783-98b83b9e5a21, identifier: FY43318
2026-03-29 20:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-29 20:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-29 20:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318 to the API
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'petrol',
 'id': '0cca6974-2926-5b82-9783-98b83b9e5a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY43318',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 137116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Saving data for FY43318: {'auction_closing_time': 1774883765.0, 'created_time': 1774524688.848057, 'last_price_update_time': 1774816323.897505}
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY43318') HTTP/1.1" 204 0
2026-03-29 20:32:03 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-29 20:32:03 [auto1.be] INFO: Scrape type for FR80699: 2
2026-03-29 20:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-29 20:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051c5500-5793-52b9-9ba2-05d30f6ce70a with scrape type 2
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 051c5500-5793-52b9-9ba2-05d30f6ce70a with scrape type 2
2026-03-29 20:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 051c5500-5793-52b9-9ba2-05d30f6ce70a, identifier: FR80699
2026-03-29 20:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-29 20:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-29 20:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699 to the API
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:38:14Z',
 'fuel_type': 'diesel',
 'id': '051c5500-5793-52b9-9ba2-05d30f6ce70a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR80699',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 166229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [auto1.be] INFO: Saving data for FR80699: {'auction_closing_time': 1774885094.0, 'created_time': 1774524709.855569, 'last_price_update_time': 1774816324.278494}
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR80699') HTTP/1.1" 204 0
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [auto1.be] INFO: Scrape type for WP21428: 2
2026-03-29 20:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428
2026-03-29 20:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b78166-5849-517d-be53-a1fff69962ef with scrape type 2
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b78166-5849-517d-be53-a1fff69962ef with scrape type 2
2026-03-29 20:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65b78166-5849-517d-be53-a1fff69962ef, identifier: WP21428
2026-03-29 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428
2026-03-29 20:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428
2026-03-29 20:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65b78166-5849-517d-be53-a1fff69962ef with identifier: WP21428 to the API
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:37:04Z',
 'fuel_type': 'diesel',
 'id': '65b78166-5849-517d-be53-a1fff69962ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP21428',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 30965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-14',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi L2 Trend',
 'transmission': 'automatic',
 'trim': 'L2 Trend',
 'year': 2023}
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [auto1.be] INFO: Saving data for WP21428: {'auction_closing_time': 1774885024.0, 'created_time': 1774513861.5767, 'last_price_update_time': 1774816324.732633}
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP21428') HTTP/1.1" 204 0
2026-03-29 20:32:04 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [auto1.be] INFO: Scrape type for XC64567: 2
2026-03-29 20:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567
2026-03-29 20:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8496672-691f-50a0-a869-7b1468276996 with scrape type 2
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8496672-691f-50a0-a869-7b1468276996 with scrape type 2
2026-03-29 20:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8496672-691f-50a0-a869-7b1468276996, identifier: XC64567
2026-03-29 20:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567
2026-03-29 20:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567
2026-03-29 20:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8496672-691f-50a0-a869-7b1468276996 with identifier: XC64567 to the API
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:37Z',
 'fuel_type': 'diesel',
 'id': 'd8496672-691f-50a0-a869-7b1468276996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC64567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 267799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [auto1.be] INFO: Saving data for XC64567: {'auction_closing_time': 1774884697.0, 'created_time': 1773348577.123637, 'last_price_update_time': 1774816325.239675}
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC64567') HTTP/1.1" 204 0
2026-03-29 20:32:05 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 20:32:05 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 20:32:05 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [auto1.be] INFO: Scrape type for EX63844: 2
2026-03-29 20:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-29 20:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e894fc-13c8-5b66-8f67-1e74190f7c30 with scrape type 2
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e894fc-13c8-5b66-8f67-1e74190f7c30 with scrape type 2
2026-03-29 20:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4e894fc-13c8-5b66-8f67-1e74190f7c30, identifier: EX63844
2026-03-29 20:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-29 20:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-29 20:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844 to the API
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:12:12Z',
 'fuel_type': 'diesel',
 'id': 'f4e894fc-13c8-5b66-8f67-1e74190f7c30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX63844',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 129189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2019}
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [auto1.be] INFO: Saving data for EX63844: {'auction_closing_time': 1774883532.0, 'created_time': 1774557063.948719, 'last_price_update_time': 1774816325.639313}
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX63844') HTTP/1.1" 204 0
2026-03-29 20:32:05 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:05 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 20:32:05 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [auto1.be] INFO: Scrape type for VA07887: 2
2026-03-29 20:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-29 20:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with scrape type 2
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with scrape type 2
2026-03-29 20:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7, identifier: VA07887
2026-03-29 20:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-29 20:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-29 20:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887 to the API
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:23Z',
 'fuel_type': 'petrol',
 'id': '5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA07887',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 60381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2020}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [auto1.be] INFO: Saving data for VA07887: {'auction_closing_time': 1774885883.0, 'created_time': 1774524717.848679, 'last_price_update_time': 1774816326.029865}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA07887') HTTP/1.1" 204 0
2026-03-29 20:32:06 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [auto1.be] INFO: Scrape type for SC36479: 2
2026-03-29 20:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-29 20:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with scrape type 2
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with scrape type 2
2026-03-29 20:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c20e58cc-3c8a-5caf-80e0-d82acc0d8396, identifier: SC36479
2026-03-29 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:06 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [auto1.be] INFO: Scrape type for FJ79675: 2
2026-03-29 20:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-29 20:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200cd7dd-45c7-51ab-846b-27b49601aaf7 with scrape type 2
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200cd7dd-45c7-51ab-846b-27b49601aaf7 with scrape type 2
2026-03-29 20:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 200cd7dd-45c7-51ab-846b-27b49601aaf7, identifier: FJ79675
2026-03-29 20:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-29 20:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479
2026-03-29 20:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c20e58cc-3c8a-5caf-80e0-d82acc0d8396 with identifier: SC36479 to the API
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:51:05Z',
 'fuel_type': 'diesel',
 'id': 'c20e58cc-3c8a-5caf-80e0-d82acc0d8396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC36479',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 58037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-08',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [auto1.be] INFO: Saving data for SC36479: {'auction_closing_time': 1774885865.0, 'created_time': 1774611103.323744, 'last_price_update_time': 1774816326.562269}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC36479') HTTP/1.1" 204 0
2026-03-29 20:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-29 20:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675
2026-03-29 20:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 200cd7dd-45c7-51ab-846b-27b49601aaf7 with identifier: FJ79675 to the API
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:51Z',
 'fuel_type': 'petrol',
 'id': '200cd7dd-45c7-51ab-846b-27b49601aaf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ79675',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 115817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [auto1.be] INFO: Saving data for FJ79675: {'auction_closing_time': 1774882851.0, 'created_time': 1774611131.264244, 'last_price_update_time': 1774816326.867908}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ79675') HTTP/1.1" 204 0
2026-03-29 20:32:06 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 20:32:06 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [auto1.be] INFO: Scrape type for TX85632: 2
2026-03-29 20:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-29 20:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e17219-8ea2-5bf3-a798-8eb189081cf9 with scrape type 2
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e17219-8ea2-5bf3-a798-8eb189081cf9 with scrape type 2
2026-03-29 20:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7e17219-8ea2-5bf3-a798-8eb189081cf9, identifier: TX85632
2026-03-29 20:32:06 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [auto1.be] INFO: Scrape type for XT90325: 2
2026-03-29 20:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-29 20:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43692e3-7ce1-5b7d-86ec-bd984af3288e with scrape type 2
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a43692e3-7ce1-5b7d-86ec-bd984af3288e with scrape type 2
2026-03-29 20:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a43692e3-7ce1-5b7d-86ec-bd984af3288e, identifier: XT90325
2026-03-29 20:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-29 20:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-29 20:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632 to the API
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:26Z',
 'fuel_type': 'petrol',
 'id': 'f7e17219-8ea2-5bf3-a798-8eb189081cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX85632',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 66001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [auto1.be] INFO: Saving data for TX85632: {'auction_closing_time': 1774884626.0, 'created_time': 1774524732.510847, 'last_price_update_time': 1774816327.334167}
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX85632') HTTP/1.1" 204 0
2026-03-29 20:32:07 [scrapy.extensions.logstats] INFO: Crawled 26 pages (at 9 pages/min), scraped 134 items (at 84 items/min)
2026-03-29 20:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-29 20:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-29 20:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325
2026-03-29 20:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a43692e3-7ce1-5b7d-86ec-bd984af3288e with identifier: XT90325 to the API
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:06:28Z',
 'fuel_type': 'petrol',
 'id': 'a43692e3-7ce1-5b7d-86ec-bd984af3288e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT90325',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 241614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-21',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2014}
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [auto1.be] INFO: Saving data for XT90325: {'auction_closing_time': 1774883188.0, 'created_time': 1774611107.000361, 'last_price_update_time': 1774816327.749458}
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT90325') HTTP/1.1" 204 0
2026-03-29 20:32:07 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 20:32:07 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [auto1.be] INFO: Scrape type for CH34151: 2
2026-03-29 20:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-29 20:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with scrape type 2
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with scrape type 2
2026-03-29 20:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b, identifier: CH34151
2026-03-29 20:32:07 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-29 20:32:07 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [auto1.be] INFO: Scrape type for CG39340: 2
2026-03-29 20:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-29 20:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 with scrape type 2
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8901d4f9-1143-56f6-b88e-bef041ff79f1 with scrape type 2
2026-03-29 20:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8901d4f9-1143-56f6-b88e-bef041ff79f1, identifier: CG39340
2026-03-29 20:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-29 20:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-29 20:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151 to the API
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:05:45Z',
 'fuel_type': 'petrol',
 'id': '2f3ae0ec-f66b-5559-8522-f87fcf855c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH34151',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 57622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2020}
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-29 20:32:08 [auto1.be] INFO: Saving data for CH34151: {'auction_closing_time': 1774883145.0, 'created_time': 1774524723.962299, 'last_price_update_time': 1774816328.269779}
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH34151') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-29 20:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340
2026-03-29 20:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8901d4f9-1143-56f6-b88e-bef041ff79f1 with identifier: CG39340 to the API
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-30T15:52:20Z',
 'fuel_type': 'petrol',
 'id': '8901d4f9-1143-56f6-b88e-bef041ff79f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG39340',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2016}
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-29 20:32:08 [auto1.be] INFO: Saving data for CG39340: {'auction_closing_time': 1774885940.0, 'created_time': 1774611124.513033, 'last_price_update_time': 1774816328.566398}
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG39340') HTTP/1.1" 204 0
2026-03-29 20:32:08 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-29 20:32:08 [auto1.be] INFO: Scrape type for VP78411: 2
2026-03-29 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-29 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9863b681-833e-52f6-b759-532c5c256fc7 with scrape type 2
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9863b681-833e-52f6-b759-532c5c256fc7 with scrape type 2
2026-03-29 20:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9863b681-833e-52f6-b759-532c5c256fc7, identifier: VP78411
2026-03-29 20:32:08 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 20:32:08 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-29 20:32:08 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-29 20:32:08 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 20:32:08 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-29 20:32:08 [auto1.be] INFO: Scrape type for LM00165: 2
2026-03-29 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165
2026-03-29 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e3efae-4532-58c6-ba1b-50ca73956c18 with scrape type 2
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37e3efae-4532-58c6-ba1b-50ca73956c18 with scrape type 2
2026-03-29 20:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 37e3efae-4532-58c6-ba1b-50ca73956c18, identifier: LM00165
2026-03-29 20:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-29 20:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411
2026-03-29 20:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9863b681-833e-52f6-b759-532c5c256fc7 with identifier: VP78411 to the API
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:30:34Z',
 'fuel_type': 'gas',
 'id': '9863b681-833e-52f6-b759-532c5c256fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP78411',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 43853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [auto1.be] INFO: Saving data for VP78411: {'auction_closing_time': 1774884634.0, 'created_time': 1774611096.395572, 'last_price_update_time': 1774816329.137654}
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP78411') HTTP/1.1" 204 0
2026-03-29 20:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165
2026-03-29 20:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165
2026-03-29 20:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 37e3efae-4532-58c6-ba1b-50ca73956c18 with identifier: LM00165 to the API
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'petrol',
 'id': '37e3efae-4532-58c6-ba1b-50ca73956c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM00165',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 47258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2022}
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [auto1.be] INFO: Saving data for LM00165: {'auction_closing_time': 1774884360.0, 'created_time': 1774092739.150304, 'last_price_update_time': 1774816329.457015}
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM00165') HTTP/1.1" 204 0
2026-03-29 20:32:09 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [auto1.be] INFO: Scrape type for DM43787: 2
2026-03-29 20:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-29 20:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31db4384-c889-5b5f-b915-6a34124f01b1 with scrape type 2
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31db4384-c889-5b5f-b915-6a34124f01b1 with scrape type 2
2026-03-29 20:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31db4384-c889-5b5f-b915-6a34124f01b1, identifier: DM43787
2026-03-29 20:32:09 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 20:32:09 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 20:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-29 20:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-29 20:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787 to the API
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:32:37Z',
 'fuel_type': 'hybrid',
 'id': '31db4384-c889-5b5f-b915-6a34124f01b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM43787',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 88783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [auto1.be] INFO: Saving data for DM43787: {'auction_closing_time': 1774884757.0, 'created_time': 1774524697.362488, 'last_price_update_time': 1774816329.867889}
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM43787') HTTP/1.1" 204 0
2026-03-29 20:32:09 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [auto1.be] INFO: Scrape type for SA37733: 2
2026-03-29 20:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-29 20:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3f4080-cb18-5257-80df-25178c1a6d1a with scrape type 2
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3f4080-cb18-5257-80df-25178c1a6d1a with scrape type 2
2026-03-29 20:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f3f4080-cb18-5257-80df-25178c1a6d1a, identifier: SA37733
2026-03-29 20:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-29 20:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733
2026-03-29 20:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f3f4080-cb18-5257-80df-25178c1a6d1a with identifier: SA37733 to the API
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:38Z',
 'fuel_type': 'diesel',
 'id': '9f3f4080-cb18-5257-80df-25178c1a6d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA37733',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 179836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2017}
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-29 20:32:10 [auto1.be] INFO: Saving data for SA37733: {'auction_closing_time': 1774883798.0, 'created_time': 1774265445.574342, 'last_price_update_time': 1774816330.381153}
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SA37733') HTTP/1.1" 204 0
2026-03-29 20:32:10 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-29 20:32:10 [auto1.be] INFO: Scrape type for ED59297: 2
2026-03-29 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-29 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159ad276-36e4-5fc6-9705-ac16c83cbb43 with scrape type 2
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 159ad276-36e4-5fc6-9705-ac16c83cbb43 with scrape type 2
2026-03-29 20:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 159ad276-36e4-5fc6-9705-ac16c83cbb43, identifier: ED59297
2026-03-29 20:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-29 20:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297
2026-03-29 20:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 159ad276-36e4-5fc6-9705-ac16c83cbb43 with identifier: ED59297 to the API
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:56Z',
 'fuel_type': 'petrol',
 'id': '159ad276-36e4-5fc6-9705-ac16c83cbb43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED59297',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-29 20:32:10 [auto1.be] INFO: Saving data for ED59297: {'auction_closing_time': 1774885496.0, 'created_time': 1774611048.04514, 'last_price_update_time': 1774816330.920481}
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED59297') HTTP/1.1" 204 0
2026-03-29 20:32:10 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 20:32:10 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-29 20:32:10 [auto1.be] INFO: Scrape type for DU38710: 2
2026-03-29 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710
2026-03-29 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af436cdf-cb97-5473-ae30-551f2541e4ea with scrape type 2
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af436cdf-cb97-5473-ae30-551f2541e4ea with scrape type 2
2026-03-29 20:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af436cdf-cb97-5473-ae30-551f2541e4ea, identifier: DU38710
2026-03-29 20:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710
2026-03-29 20:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710
2026-03-29 20:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af436cdf-cb97-5473-ae30-551f2541e4ea with identifier: DU38710 to the API
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:18:23Z',
 'fuel_type': 'petrol',
 'id': 'af436cdf-cb97-5473-ae30-551f2541e4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU38710',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 130042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-17',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.1 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2010}
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [auto1.be] INFO: Saving data for DU38710: {'auction_closing_time': 1774883903.0, 'created_time': 1774513852.99087, 'last_price_update_time': 1774816331.438203}
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DU38710') HTTP/1.1" 204 0
2026-03-29 20:32:11 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 20:32:11 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 20:32:11 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [auto1.be] INFO: Scrape type for YK80434: 2
2026-03-29 20:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-29 20:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c828c7e-bbca-5656-b090-1d8e5810870d with scrape type 2
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c828c7e-bbca-5656-b090-1d8e5810870d with scrape type 2
2026-03-29 20:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c828c7e-bbca-5656-b090-1d8e5810870d, identifier: YK80434
2026-03-29 20:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-29 20:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434
2026-03-29 20:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c828c7e-bbca-5656-b090-1d8e5810870d with identifier: YK80434 to the API
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:38Z',
 'fuel_type': 'petrol',
 'id': '8c828c7e-bbca-5656-b090-1d8e5810870d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK80434',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 62610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [auto1.be] INFO: Saving data for YK80434: {'auction_closing_time': 1774883438.0, 'created_time': 1774611126.069394, 'last_price_update_time': 1774816331.8763}
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK80434') HTTP/1.1" 204 0
2026-03-29 20:32:11 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-29 20:32:11 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [auto1.be] INFO: Scrape type for TU11660: 2
2026-03-29 20:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-29 20:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with scrape type 2
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with scrape type 2
2026-03-29 20:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b75bf36-de36-5b83-9cc7-5682f55ecc50, identifier: TU11660
2026-03-29 20:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-29 20:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660
2026-03-29 20:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b75bf36-de36-5b83-9cc7-5682f55ecc50 with identifier: TU11660 to the API
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:12:05Z',
 'fuel_type': 'diesel',
 'id': '1b75bf36-de36-5b83-9cc7-5682f55ecc50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU11660',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 34729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-29 20:32:12 [auto1.be] INFO: Saving data for TU11660: {'auction_closing_time': 1774883525.0, 'created_time': 1773402051.640117, 'last_price_update_time': 1774816332.311311}
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU11660') HTTP/1.1" 204 0
2026-03-29 20:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:12 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 20:32:12 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 20:32:12 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-29 20:32:12 [auto1.be] INFO: Scrape type for LP07116: 2
2026-03-29 20:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-29 20:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with scrape type 2
2026-03-29 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with scrape type 2
2026-03-29 20:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1, identifier: LP07116
2026-03-29 20:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-29 20:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116
2026-03-29 20:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1 with identifier: LP07116 to the API
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:04:41Z',
 'fuel_type': 'diesel',
 'id': 'b6eb1070-155b-5ebc-b347-9b4d1d5e2aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP07116',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 189459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-29 20:32:12 [auto1.be] INFO: Saving data for LP07116: {'auction_closing_time': 1774883081.0, 'created_time': 1774611102.982642, 'last_price_update_time': 1774816332.737059}
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP07116') HTTP/1.1" 204 0
2026-03-29 20:32:12 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 20:32:12 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-29 20:32:12 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-29 20:32:12 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-29 20:32:12 [auto1.be] INFO: Scrape type for BK01349: 2
2026-03-29 20:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-29 20:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with scrape type 2
2026-03-29 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with scrape type 2
2026-03-29 20:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934, identifier: BK01349
2026-03-29 20:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-29 20:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-29 20:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349 to the API
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:08Z',
 'fuel_type': 'petrol',
 'id': 'f2ec4fbc-5d35-5fe3-b628-1228b4b3d934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK01349',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 22103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2022}
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [auto1.be] INFO: Saving data for BK01349: {'auction_closing_time': 1774884428.0, 'created_time': 1774524676.159891, 'last_price_update_time': 1774816333.213538}
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BK01349') HTTP/1.1" 204 0
2026-03-29 20:32:13 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [auto1.be] INFO: Scrape type for BA37972: 2
2026-03-29 20:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-29 20:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed1cb58-a86a-5424-a984-2ac5d160db97 with scrape type 2
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ed1cb58-a86a-5424-a984-2ac5d160db97 with scrape type 2
2026-03-29 20:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ed1cb58-a86a-5424-a984-2ac5d160db97, identifier: BA37972
2026-03-29 20:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-29 20:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-29 20:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972 to the API
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': '4ed1cb58-a86a-5424-a984-2ac5d160db97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA37972',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara',
 'odometer': 66980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-04',
 'seller_name': None,
 'title': 'Citroen Xsara 1.4 Millesime',
 'transmission': 'manual',
 'trim': 'Millesime',
 'year': 2001}
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [auto1.be] INFO: Saving data for BA37972: {'auction_closing_time': 1774884913.0, 'created_time': 1773922616.315566, 'last_price_update_time': 1774816333.583453}
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA37972') HTTP/1.1" 204 0
2026-03-29 20:32:13 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:13 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 20:32:13 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [auto1.be] INFO: Scrape type for SC85120: 2
2026-03-29 20:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-29 20:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f350627-37d4-5531-94ae-9eb0c0194e94 with scrape type 2
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f350627-37d4-5531-94ae-9eb0c0194e94 with scrape type 2
2026-03-29 20:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f350627-37d4-5531-94ae-9eb0c0194e94, identifier: SC85120
2026-03-29 20:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-29 20:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120
2026-03-29 20:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f350627-37d4-5531-94ae-9eb0c0194e94 with identifier: SC85120 to the API
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'diesel',
 'id': '8f350627-37d4-5531-94ae-9eb0c0194e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC85120',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 185071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [auto1.be] INFO: Saving data for SC85120: {'auction_closing_time': 1774884333.0, 'created_time': 1774611100.495429, 'last_price_update_time': 1774816333.98589}
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC85120') HTTP/1.1" 204 0
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Scrape type for WP69561: 2
2026-03-29 20:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-29 20:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aaa1b77-9d44-59bd-9453-925cb5511883 with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aaa1b77-9d44-59bd-9453-925cb5511883 with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aaa1b77-9d44-59bd-9453-925cb5511883, identifier: WP69561
2026-03-29 20:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Scrape type for TW09601: 2
2026-03-29 20:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-29 20:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692d14de-a005-5420-90ce-56cf238963bc with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 692d14de-a005-5420-90ce-56cf238963bc with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 692d14de-a005-5420-90ce-56cf238963bc, identifier: TW09601
2026-03-29 20:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-29 20:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561
2026-03-29 20:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aaa1b77-9d44-59bd-9453-925cb5511883 with identifier: WP69561 to the API
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:01:45Z',
 'fuel_type': 'petrol',
 'id': '6aaa1b77-9d44-59bd-9453-925cb5511883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP69561',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 193036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2014}
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Saving data for WP69561: {'auction_closing_time': 1774882905.0, 'created_time': 1773833774.500726, 'last_price_update_time': 1774816334.524349}
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP69561') HTTP/1.1" 204 0
2026-03-29 20:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-29 20:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-29 20:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601 to the API
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:42:09Z',
 'fuel_type': 'diesel',
 'id': '692d14de-a005-5420-90ce-56cf238963bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW09601',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 182252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Saving data for TW09601: {'auction_closing_time': 1774885329.0, 'created_time': 1774557030.384689, 'last_price_update_time': 1774816334.798948}
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW09601') HTTP/1.1" 204 0
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Scrape type for VB04696: 2
2026-03-29 20:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-29 20:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1452a75b-4551-5745-b36a-48fe36f546f8 with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1452a75b-4551-5745-b36a-48fe36f546f8 with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1452a75b-4551-5745-b36a-48fe36f546f8, identifier: VB04696
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 20:32:14 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Scrape type for DY28234: 2
2026-03-29 20:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-29 20:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with scrape type 2
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with scrape type 2
2026-03-29 20:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134, identifier: DY28234
2026-03-29 20:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-29 20:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696
2026-03-29 20:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1452a75b-4551-5745-b36a-48fe36f546f8 with identifier: VB04696 to the API
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:07:00Z',
 'fuel_type': 'petrol',
 'id': '1452a75b-4551-5745-b36a-48fe36f546f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB04696',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 106180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Saving data for VB04696: {'auction_closing_time': 1774883220.0, 'created_time': 1773866643.764642, 'last_price_update_time': 1774816335.408583}
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB04696') HTTP/1.1" 204 0
2026-03-29 20:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-29 20:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234
2026-03-29 20:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51e13d09-bd7d-51b2-b761-5a5a3ed5a134 with identifier: DY28234 to the API
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:18:54Z',
 'fuel_type': 'diesel',
 'id': '51e13d09-bd7d-51b2-b761-5a5a3ed5a134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY28234',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 175226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Saving data for DY28234: {'auction_closing_time': 1774883934.0, 'created_time': 1773834165.871049, 'last_price_update_time': 1774816335.801494}
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY28234') HTTP/1.1" 204 0
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Scrape type for FH97290: 2
2026-03-29 20:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-29 20:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5127d3-9044-5174-b42b-c727e0da4b7c with scrape type 2
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da5127d3-9044-5174-b42b-c727e0da4b7c with scrape type 2
2026-03-29 20:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da5127d3-9044-5174-b42b-c727e0da4b7c, identifier: FH97290
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 20:32:15 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-29 20:32:15 [auto1.be] INFO: Scrape type for PY12122: 2
2026-03-29 20:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-29 20:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45ffa21f-0452-5540-9c3b-b3e53e421a5d with scrape type 2
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45ffa21f-0452-5540-9c3b-b3e53e421a5d with scrape type 2
2026-03-29 20:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45ffa21f-0452-5540-9c3b-b3e53e421a5d, identifier: PY12122
2026-03-29 20:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-29 20:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290
2026-03-29 20:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da5127d3-9044-5174-b42b-c727e0da4b7c with identifier: FH97290 to the API
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:14:30Z',
 'fuel_type': 'petrol',
 'id': 'da5127d3-9044-5174-b42b-c727e0da4b7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH97290',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 59826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-28',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-29 20:32:16 [auto1.be] INFO: Saving data for FH97290: {'auction_closing_time': 1774883670.0, 'created_time': 1774611133.147032, 'last_price_update_time': 1774816336.360617}
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH97290') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-29 20:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122
2026-03-29 20:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45ffa21f-0452-5540-9c3b-b3e53e421a5d with identifier: PY12122 to the API
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:40:51Z',
 'fuel_type': 'diesel',
 'id': '45ffa21f-0452-5540-9c3b-b3e53e421a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY12122',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 125711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-14',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
 'transmission': 'manual',
 'trim': 'GT L1',
 'year': 2019}
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-29 20:32:16 [auto1.be] INFO: Saving data for PY12122: {'auction_closing_time': 1774885251.0, 'created_time': 1773866527.193939, 'last_price_update_time': 1774816336.670118}
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY12122') HTTP/1.1" 204 0
2026-03-29 20:32:16 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-29 20:32:16 [auto1.be] INFO: Scrape type for SZ65946: 2
2026-03-29 20:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946
2026-03-29 20:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51171fe-f531-5ad7-996b-129f0fc32398 with scrape type 2
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51171fe-f531-5ad7-996b-129f0fc32398 with scrape type 2
2026-03-29 20:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b51171fe-f531-5ad7-996b-129f0fc32398, identifier: SZ65946
2026-03-29 20:32:16 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 20:32:16 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 20:32:16 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-29 20:32:16 [auto1.be] INFO: Scrape type for KU11213: 2
2026-03-29 20:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-29 20:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with scrape type 2
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with scrape type 2
2026-03-29 20:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7be753c5-0a2c-56d4-8600-92b70c76dbe3, identifier: KU11213
2026-03-29 20:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946
2026-03-29 20:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946
2026-03-29 20:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b51171fe-f531-5ad7-996b-129f0fc32398 with identifier: SZ65946 to the API
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:22Z',
 'fuel_type': 'diesel',
 'id': 'b51171fe-f531-5ad7-996b-129f0fc32398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ65946',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 280276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'BMW 3er 318d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-29 20:32:17 [auto1.be] INFO: Saving data for SZ65946: {'auction_closing_time': 1774884682.0, 'created_time': 1774125073.571205, 'last_price_update_time': 1774816337.257696}
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ65946') HTTP/1.1" 204 0
2026-03-29 20:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-29 20:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213
2026-03-29 20:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7be753c5-0a2c-56d4-8600-92b70c76dbe3 with identifier: KU11213 to the API
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:39Z',
 'fuel_type': 'diesel',
 'id': '7be753c5-0a2c-56d4-8600-92b70c76dbe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU11213',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 227835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-16',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2014}
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-29 20:32:17 [auto1.be] INFO: Saving data for KU11213: {'auction_closing_time': 1774884519.0, 'created_time': 1773693323.699756, 'last_price_update_time': 1774816337.675041}
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU11213') HTTP/1.1" 204 0
2026-03-29 20:32:17 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 20:32:17 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-29 20:32:17 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-29 20:32:17 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 20:32:17 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-29 20:32:17 [auto1.be] INFO: Scrape type for WH33984: 2
2026-03-29 20:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-29 20:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with scrape type 2
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with scrape type 2
2026-03-29 20:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8, identifier: WH33984
2026-03-29 20:32:17 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-29 20:32:17 [auto1.be] INFO: Scrape type for DC17534: 2
2026-03-29 20:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-29 20:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with scrape type 2
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with scrape type 2
2026-03-29 20:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66, identifier: DC17534
2026-03-29 20:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-29 20:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984
2026-03-29 20:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8 with identifier: WH33984 to the API
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:06Z',
 'fuel_type': 'diesel',
 'id': '0ad18f0a-7ae3-5a7c-829f-7a467d32a2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH33984',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 287672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2010}
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [auto1.be] INFO: Saving data for WH33984: {'auction_closing_time': 1774886346.0, 'created_time': 1773909043.405104, 'last_price_update_time': 1774816338.225786}
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH33984') HTTP/1.1" 204 0
2026-03-29 20:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-29 20:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534
2026-03-29 20:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4debd35f-e5d5-5c62-80d3-2312a6fc1a66 with identifier: DC17534 to the API
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:13:40Z',
 'fuel_type': 'petrol',
 'id': '4debd35f-e5d5-5c62-80d3-2312a6fc1a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC17534',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 216832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [auto1.be] INFO: Saving data for DC17534: {'auction_closing_time': 1774883620.0, 'created_time': 1774611085.773547, 'last_price_update_time': 1774816338.550512}
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC17534') HTTP/1.1" 204 0
2026-03-29 20:32:18 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 20:32:18 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-29 20:32:18 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-29 20:32:18 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 20:32:18 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [auto1.be] INFO: Scrape type for HM84114: 2
2026-03-29 20:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114
2026-03-29 20:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598a5a4c-96de-506d-ade6-640b25698ac9 with scrape type 2
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 598a5a4c-96de-506d-ade6-640b25698ac9 with scrape type 2
2026-03-29 20:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 598a5a4c-96de-506d-ade6-640b25698ac9, identifier: HM84114
2026-03-29 20:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114
2026-03-29 20:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114
2026-03-29 20:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 598a5a4c-96de-506d-ade6-640b25698ac9 with identifier: HM84114 to the API
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:28:00Z',
 'fuel_type': 'gas',
 'id': '598a5a4c-96de-506d-ade6-640b25698ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM84114',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 90166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-31',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TGI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [auto1.be] INFO: Saving data for HM84114: {'auction_closing_time': 1774884480.0, 'created_time': 1774125146.159218, 'last_price_update_time': 1774816339.025019}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM84114') HTTP/1.1" 204 0
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [auto1.be] INFO: Scrape type for FN16517: 2
2026-03-29 20:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-29 20:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with scrape type 2
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with scrape type 2
2026-03-29 20:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a90caf3-f8a5-56c6-9be0-336444f5ad60, identifier: FN16517
2026-03-29 20:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-29 20:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517
2026-03-29 20:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a90caf3-f8a5-56c6-9be0-336444f5ad60 with identifier: FN16517 to the API
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'diesel',
 'id': '2a90caf3-f8a5-56c6-9be0-336444f5ad60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN16517',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 137494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2014}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [auto1.be] INFO: Saving data for FN16517: {'auction_closing_time': 1774885194.0, 'created_time': 1774611057.312563, 'last_price_update_time': 1774816339.465279}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN16517') HTTP/1.1" 204 0
2026-03-29 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-29 20:32:19 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [auto1.be] INFO: Scrape type for MK20825: 2
2026-03-29 20:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-29 20:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9060c77e-58a0-56e4-a70f-65ffc708ff7a with scrape type 2
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9060c77e-58a0-56e4-a70f-65ffc708ff7a with scrape type 2
2026-03-29 20:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9060c77e-58a0-56e4-a70f-65ffc708ff7a, identifier: MK20825
2026-03-29 20:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-29 20:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-29 20:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825 to the API
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '9060c77e-58a0-56e4-a70f-65ffc708ff7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK20825',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 184750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-04-20',
 'seller_name': None,
 'title': 'Lancia Delta 1.9 Turbodiesel TD LS',
 'transmission': 'manual',
 'trim': 'TD LS',
 'year': 1999}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Saving data for MK20825: {'auction_closing_time': 1774884037.0, 'created_time': 1773237091.551978, 'last_price_update_time': 1774816340.002544}
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK20825') HTTP/1.1" 204 0
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Scrape type for YS48127: 2
2026-03-29 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-29 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ee751d-f055-5e28-95a6-64d8df2ac6be with scrape type 2
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ee751d-f055-5e28-95a6-64d8df2ac6be with scrape type 2
2026-03-29 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6ee751d-f055-5e28-95a6-64d8df2ac6be, identifier: YS48127
2026-03-29 20:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-29 20:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-29 20:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127 to the API
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:15:41Z',
 'fuel_type': 'petrol',
 'id': 'f6ee751d-f055-5e28-95a6-64d8df2ac6be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS48127',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 117688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Saving data for YS48127: {'auction_closing_time': 1774883741.0, 'created_time': 1774557038.688555, 'last_price_update_time': 1774816340.396092}
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS48127') HTTP/1.1" 204 0
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Scrape type for ZC67013: 2
2026-03-29 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-29 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with scrape type 2
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with scrape type 2
2026-03-29 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4, identifier: ZC67013
2026-03-29 20:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-29 20:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-29 20:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013 to the API
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:01Z',
 'fuel_type': 'diesel',
 'id': '5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC67013',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 233200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Saving data for ZC67013: {'auction_closing_time': 1774882801.0, 'created_time': 1774254677.819703, 'last_price_update_time': 1774816340.846341}
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC67013') HTTP/1.1" 204 0
2026-03-29 20:32:20 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 20:32:20 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [auto1.be] INFO: Scrape type for ZK51287: 2
2026-03-29 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287
2026-03-29 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with scrape type 2
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with scrape type 2
2026-03-29 20:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a, identifier: ZK51287
2026-03-29 20:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287
2026-03-29 20:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287
2026-03-29 20:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a with identifier: ZK51287 to the API
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:59:16Z',
 'fuel_type': 'diesel',
 'id': 'fdabd5d7-4b4b-5f6f-9b8e-3984e1c3a10a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51287',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 71954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-16',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D Eco',
 'transmission': 'automatic',
 'trim': 'Eco',
 'year': 2014}
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-29 20:32:21 [auto1.be] INFO: Saving data for ZK51287: {'auction_closing_time': 1774886356.0, 'created_time': 1774513858.892983, 'last_price_update_time': 1774816341.348572}
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK51287') HTTP/1.1" 204 0
2026-03-29 20:32:21 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-29 20:32:21 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-29 20:32:21 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-29 20:32:21 [auto1.be] INFO: Scrape type for UN77217: 2
2026-03-29 20:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-29 20:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5b5348-5b73-5def-863b-43c052e63e32 with scrape type 2
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5b5348-5b73-5def-863b-43c052e63e32 with scrape type 2
2026-03-29 20:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e5b5348-5b73-5def-863b-43c052e63e32, identifier: UN77217
2026-03-29 20:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-29 20:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-29 20:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217 to the API
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:20Z',
 'fuel_type': 'petrol',
 'id': '0e5b5348-5b73-5def-863b-43c052e63e32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN77217',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 70995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2013}
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-29 20:32:21 [auto1.be] INFO: Saving data for UN77217: {'auction_closing_time': 1774883720.0, 'created_time': 1774557033.83047, 'last_price_update_time': 1774816341.74756}
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UN77217') HTTP/1.1" 204 0
2026-03-29 20:32:21 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 20:32:21 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-29 20:32:21 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-29 20:32:21 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-29 20:32:21 [auto1.be] INFO: Scrape type for NS73936: 2
2026-03-29 20:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-29 20:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with scrape type 2
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with scrape type 2
2026-03-29 20:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127, identifier: NS73936
2026-03-29 20:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-29 20:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-29 20:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936 to the API
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:12:01Z',
 'fuel_type': 'petrol',
 'id': '8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS73936',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 58170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Saving data for NS73936: {'auction_closing_time': 1774883521.0, 'created_time': 1774524682.966644, 'last_price_update_time': 1774816342.145486}
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS73936') HTTP/1.1" 204 0
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Scrape type for ZN76480: 2
2026-03-29 20:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-29 20:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034d32e7-ca29-5991-8ed9-2bb27008c1ff with scrape type 2
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034d32e7-ca29-5991-8ed9-2bb27008c1ff with scrape type 2
2026-03-29 20:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 034d32e7-ca29-5991-8ed9-2bb27008c1ff, identifier: ZN76480
2026-03-29 20:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-29 20:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480
2026-03-29 20:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 034d32e7-ca29-5991-8ed9-2bb27008c1ff with identifier: ZN76480 to the API
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:09:21Z',
 'fuel_type': 'diesel',
 'id': '034d32e7-ca29-5991-8ed9-2bb27008c1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN76480',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 144963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2022}
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Saving data for ZN76480: {'auction_closing_time': 1774883361.0, 'created_time': 1774611127.957654, 'last_price_update_time': 1774816342.697648}
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN76480') HTTP/1.1" 204 0
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 20:32:22 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-29 20:32:22 [auto1.be] INFO: Scrape type for TR87241: 2
2026-03-29 20:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-29 20:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723da491-dff4-5725-97f1-c814e1c6991f with scrape type 2
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723da491-dff4-5725-97f1-c814e1c6991f with scrape type 2
2026-03-29 20:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 723da491-dff4-5725-97f1-c814e1c6991f, identifier: TR87241
2026-03-29 20:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-29 20:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-29 20:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241 to the API
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '723da491-dff4-5725-97f1-c814e1c6991f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR87241',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 131420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [auto1.be] INFO: Saving data for TR87241: {'auction_closing_time': 1774884468.0, 'created_time': 1774524714.970198, 'last_price_update_time': 1774816343.213056}
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR87241') HTTP/1.1" 204 0
2026-03-29 20:32:23 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 20:32:23 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 20:32:23 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [auto1.be] INFO: Scrape type for DJ08738: 2
2026-03-29 20:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738
2026-03-29 20:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6253c09c-e24e-52be-bf97-c105ea6690f8 with scrape type 2
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6253c09c-e24e-52be-bf97-c105ea6690f8 with scrape type 2
2026-03-29 20:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6253c09c-e24e-52be-bf97-c105ea6690f8, identifier: DJ08738
2026-03-29 20:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738
2026-03-29 20:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738
2026-03-29 20:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738 to the API
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:53:47Z',
 'fuel_type': 'diesel',
 'id': '6253c09c-e24e-52be-bf97-c105ea6690f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ08738',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 238631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [auto1.be] INFO: Saving data for DJ08738: {'auction_closing_time': 1774886027.0, 'created_time': 1773349431.501062, 'last_price_update_time': 1774816343.617052}
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ08738') HTTP/1.1" 204 0
2026-03-29 20:32:23 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-29 20:32:23 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [auto1.be] INFO: Scrape type for XB17770: 2
2026-03-29 20:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-29 20:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5034336-1fbd-51ae-be60-ec6bb35bdc82 with scrape type 2
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5034336-1fbd-51ae-be60-ec6bb35bdc82 with scrape type 2
2026-03-29 20:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5034336-1fbd-51ae-be60-ec6bb35bdc82, identifier: XB17770
2026-03-29 20:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-29 20:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770
2026-03-29 20:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5034336-1fbd-51ae-be60-ec6bb35bdc82 with identifier: XB17770 to the API
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:52:36Z',
 'fuel_type': 'diesel',
 'id': 'c5034336-1fbd-51ae-be60-ec6bb35bdc82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB17770',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 99960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-25',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2021}
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Saving data for XB17770: {'auction_closing_time': 1774885956.0, 'created_time': 1773236499.564429, 'last_price_update_time': 1774816344.076562}
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB17770') HTTP/1.1" 204 0
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Scrape type for SN22557: 2
2026-03-29 20:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557
2026-03-29 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c68377-9458-530d-8c69-990ea6be5db1 with scrape type 2
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15c68377-9458-530d-8c69-990ea6be5db1 with scrape type 2
2026-03-29 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15c68377-9458-530d-8c69-990ea6be5db1, identifier: SN22557
2026-03-29 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557
2026-03-29 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557
2026-03-29 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557 to the API
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:36:10Z',
 'fuel_type': 'diesel',
 'id': '15c68377-9458-530d-8c69-990ea6be5db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN22557',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 155085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-11',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Saving data for SN22557: {'auction_closing_time': 1774884970.0, 'created_time': 1774729925.726207, 'last_price_update_time': 1774816344.456042}
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN22557') HTTP/1.1" 204 0
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Scrape type for MV28568: 2
2026-03-29 20:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-29 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0151fb6-a780-53c4-a58c-d924cd3748a0 with scrape type 2
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0151fb6-a780-53c4-a58c-d924cd3748a0 with scrape type 2
2026-03-29 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0151fb6-a780-53c4-a58c-d924cd3748a0, identifier: MV28568
2026-03-29 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-29 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568
2026-03-29 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0151fb6-a780-53c4-a58c-d924cd3748a0 with identifier: MV28568 to the API
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:25Z',
 'fuel_type': 'diesel',
 'id': 'a0151fb6-a780-53c4-a58c-d924cd3748a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV28568',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 256854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Saving data for MV28568: {'auction_closing_time': 1774883725.0, 'created_time': 1773132175.677203, 'last_price_update_time': 1774816344.897382}
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV28568') HTTP/1.1" 204 0
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Scrape type for PS82481: 0
2026-03-29 20:32:24 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [auto1.be] INFO: Scrape type for UU07035: 2
2026-03-29 20:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-29 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4c9849-e711-542c-a3e1-3623346b18d0 with scrape type 2
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4c9849-e711-542c-a3e1-3623346b18d0 with scrape type 2
2026-03-29 20:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee4c9849-e711-542c-a3e1-3623346b18d0, identifier: UU07035
2026-03-29 20:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-29 20:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035
2026-03-29 20:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee4c9849-e711-542c-a3e1-3623346b18d0 with identifier: UU07035 to the API
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:44:45Z',
 'fuel_type': 'petrol',
 'id': 'ee4c9849-e711-542c-a3e1-3623346b18d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU07035',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 204364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [auto1.be] INFO: Saving data for UU07035: {'auction_closing_time': 1774885485.0, 'created_time': 1773693340.499912, 'last_price_update_time': 1774816345.353548}
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU07035') HTTP/1.1" 204 0
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [auto1.be] INFO: Scrape type for AZ39903: 0
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [auto1.be] INFO: Scrape type for HB98543: 2
2026-03-29 20:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-29 20:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88ce288-a0c0-5486-997d-d0961638670b with scrape type 2
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c88ce288-a0c0-5486-997d-d0961638670b with scrape type 2
2026-03-29 20:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c88ce288-a0c0-5486-997d-d0961638670b, identifier: HB98543
2026-03-29 20:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-29 20:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543
2026-03-29 20:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c88ce288-a0c0-5486-997d-d0961638670b with identifier: HB98543 to the API
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:56Z',
 'fuel_type': 'diesel',
 'id': 'c88ce288-a0c0-5486-997d-d0961638670b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB98543',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 171169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [auto1.be] INFO: Saving data for HB98543: {'auction_closing_time': 1774885676.0, 'created_time': 1773693735.531847, 'last_price_update_time': 1774816345.953668}
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB98543') HTTP/1.1" 204 0
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 20:32:25 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 20:32:26 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:26 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-29 20:32:26 [auto1.be] INFO: Scrape type for NL83155: 2
2026-03-29 20:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155
2026-03-29 20:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09cb5409-1661-5876-b159-aa86aeb6d79b with scrape type 2
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09cb5409-1661-5876-b159-aa86aeb6d79b with scrape type 2
2026-03-29 20:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09cb5409-1661-5876-b159-aa86aeb6d79b, identifier: NL83155
2026-03-29 20:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155
2026-03-29 20:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155
2026-03-29 20:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155 to the API
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:52:00Z',
 'fuel_type': 'hybrid',
 'id': '09cb5409-1661-5876-b159-aa86aeb6d79b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL83155',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 232527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 1.6 T-GDI Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2022}
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-29 20:32:26 [auto1.be] INFO: Saving data for NL83155: {'auction_closing_time': 1774885920.0, 'created_time': 1774002051.720764, 'last_price_update_time': 1774816346.478346}
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NL83155') HTTP/1.1" 204 0
2026-03-29 20:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:26 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 20:32:26 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 20:32:26 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-29 20:32:26 [auto1.be] INFO: Scrape type for PF94112: 0
2026-03-29 20:32:26 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-29 20:32:26 [auto1.be] INFO: Scrape type for XT95399: 0
2026-03-29 20:32:26 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-29 20:32:26 [auto1.be] INFO: Scrape type for NT98676: 2
2026-03-29 20:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676
2026-03-29 20:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with scrape type 2
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with scrape type 2
2026-03-29 20:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df4d6ab1-c882-5e9a-9f24-38ec02f25d49, identifier: NT98676
2026-03-29 20:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676
2026-03-29 20:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676
2026-03-29 20:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676 to the API
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:13:56Z',
 'fuel_type': 'diesel',
 'id': 'df4d6ab1-c882-5e9a-9f24-38ec02f25d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT98676',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 80974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2016}
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-29 20:32:26 [auto1.be] INFO: Saving data for NT98676: {'auction_closing_time': 1774883636.0, 'created_time': 1773348770.796634, 'last_price_update_time': 1774816346.98138}
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NT98676') HTTP/1.1" 204 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for ZA12378: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for FJ54867: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for KD88013: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for YY44687: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for BX66623: 2
2026-03-29 20:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623
2026-03-29 20:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aada4d1-3ace-5315-a4be-6ee742d97578 with scrape type 2
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aada4d1-3ace-5315-a4be-6ee742d97578 with scrape type 2
2026-03-29 20:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1aada4d1-3ace-5315-a4be-6ee742d97578, identifier: BX66623
2026-03-29 20:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623
2026-03-29 20:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623
2026-03-29 20:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623 to the API
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'petrol',
 'id': '1aada4d1-3ace-5315-a4be-6ee742d97578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX66623',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 83206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-09',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Terra',
 'transmission': 'manual',
 'trim': 'Terra',
 'year': 2003}
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Saving data for BX66623: {'auction_closing_time': 1774886120.0, 'created_time': 1774729943.259469, 'last_price_update_time': 1774816347.469943}
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX66623') HTTP/1.1" 204 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for DM24490: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for PM87207: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for XW30503: 0
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 20:32:27 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Scrape type for UE36464: 2
2026-03-29 20:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464
2026-03-29 20:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca17713-763f-5607-a49f-d3ff58b6c062 with scrape type 2
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ca17713-763f-5607-a49f-d3ff58b6c062 with scrape type 2
2026-03-29 20:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ca17713-763f-5607-a49f-d3ff58b6c062, identifier: UE36464
2026-03-29 20:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464
2026-03-29 20:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464
2026-03-29 20:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464 to the API
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:35Z',
 'fuel_type': 'petrol',
 'id': '3ca17713-763f-5607-a49f-d3ff58b6c062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE36464',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 212956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-29 20:32:27 [auto1.be] INFO: Saving data for UE36464: {'auction_closing_time': 1774885115.0, 'created_time': 1774729930.00689, 'last_price_update_time': 1774816347.985587}
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE36464') HTTP/1.1" 204 0
2026-03-29 20:32:28 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-29 20:32:28 [auto1.be] INFO: Scrape type for ER02883: 2
2026-03-29 20:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883
2026-03-29 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f088b6-ff39-58be-b9c4-e444d2ca44dd with scrape type 2
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f088b6-ff39-58be-b9c4-e444d2ca44dd with scrape type 2
2026-03-29 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9f088b6-ff39-58be-b9c4-e444d2ca44dd, identifier: ER02883
2026-03-29 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883
2026-03-29 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883
2026-03-29 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883 to the API
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'diesel',
 'id': 'c9f088b6-ff39-58be-b9c4-e444d2ca44dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER02883',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 63280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi HDi',
 'transmission': 'manual',
 'trim': 'HDi',
 'year': 2013}
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-29 20:32:28 [auto1.be] INFO: Saving data for ER02883: {'auction_closing_time': 1774885152.0, 'created_time': 1774001877.925007, 'last_price_update_time': 1774816348.388071}
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER02883') HTTP/1.1" 204 0
2026-03-29 20:32:28 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 20:32:28 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 20:32:28 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-29 20:32:28 [auto1.be] INFO: Scrape type for HT18059: 2
2026-03-29 20:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059
2026-03-29 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with scrape type 2
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with scrape type 2
2026-03-29 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a6b3ab-bec2-5d71-805b-b155d2d119b5, identifier: HT18059
2026-03-29 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059
2026-03-29 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059
2026-03-29 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059 to the API
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'diesel',
 'id': '96a6b3ab-bec2-5d71-805b-b155d2d119b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT18059',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC AMG Line',
 'transmission': 'manual',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-29 20:32:28 [auto1.be] INFO: Saving data for HT18059: {'auction_closing_time': 1774883764.0, 'created_time': 1774729944.957124, 'last_price_update_time': 1774816348.765394}
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT18059') HTTP/1.1" 204 0
2026-03-29 20:32:28 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-29 20:32:28 [auto1.be] INFO: Scrape type for PE64709: 2
2026-03-29 20:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709
2026-03-29 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a98804c-4fff-5fba-a931-235c16769837 with scrape type 2
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a98804c-4fff-5fba-a931-235c16769837 with scrape type 2
2026-03-29 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a98804c-4fff-5fba-a931-235c16769837, identifier: PE64709
2026-03-29 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709
2026-03-29 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709
2026-03-29 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709 to the API
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:40Z',
 'fuel_type': 'petrol',
 'id': '4a98804c-4fff-5fba-a931-235c16769837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE64709',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 152669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-02',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.4 TURBO LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2013}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-29 20:32:29 [auto1.be] INFO: Saving data for PE64709: {'auction_closing_time': 1774884280.0, 'created_time': 1774729928.058403, 'last_price_update_time': 1774816349.156838}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE64709') HTTP/1.1" 204 0
2026-03-29 20:32:29 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 20:32:29 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 20:32:29 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 20:32:29 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-29 20:32:29 [auto1.be] INFO: Scrape type for ZM05640: 2
2026-03-29 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640
2026-03-29 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with scrape type 2
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with scrape type 2
2026-03-29 20:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a62d7aee-4196-5a13-9ec7-7d0e5e259d13, identifier: ZM05640
2026-03-29 20:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640
2026-03-29 20:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640
2026-03-29 20:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640 to the API
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:01:20Z',
 'fuel_type': 'petrol',
 'id': 'a62d7aee-4196-5a13-9ec7-7d0e5e259d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM05640',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Elysée',
 'odometer': 78808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-25',
 'seller_name': None,
 'title': 'Citroen C-Elysée 1.6 VTi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2018}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-29 20:32:29 [auto1.be] INFO: Saving data for ZM05640: {'auction_closing_time': 1774882880.0, 'created_time': 1774729947.67714, 'last_price_update_time': 1774816349.636421}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM05640') HTTP/1.1" 204 0
2026-03-29 20:32:29 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-29 20:32:29 [auto1.be] INFO: Scrape type for KT01454: 2
2026-03-29 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454
2026-03-29 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with scrape type 2
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with scrape type 2
2026-03-29 20:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b, identifier: KT01454
2026-03-29 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454
2026-03-29 20:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454
2026-03-29 20:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454 to the API
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'diesel',
 'id': '4ab82dcf-e6eb-5711-bcd5-62f7bd47182b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT01454',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 106263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2019}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Saving data for KT01454: {'auction_closing_time': 1774885944.0, 'created_time': 1774729945.397327, 'last_price_update_time': 1774816350.044894}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT01454') HTTP/1.1" 204 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for AC59433: 2
2026-03-29 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433
2026-03-29 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9664b1b-d541-56c0-add5-f44f972b267d with scrape type 2
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9664b1b-d541-56c0-add5-f44f972b267d with scrape type 2
2026-03-29 20:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9664b1b-d541-56c0-add5-f44f972b267d, identifier: AC59433
2026-03-29 20:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433
2026-03-29 20:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433
2026-03-29 20:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433 to the API
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:11:21Z',
 'fuel_type': 'diesel',
 'id': 'f9664b1b-d541-56c0-add5-f44f972b267d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC59433',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 180365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Kia Soul 1.6 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Saving data for AC59433: {'auction_closing_time': 1774883481.0, 'created_time': 1773348458.506899, 'last_price_update_time': 1774816350.422433}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC59433') HTTP/1.1" 204 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for GM68229: 2
2026-03-29 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229
2026-03-29 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e398921-f1a7-52b2-93bb-1880f80d2236 with scrape type 2
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e398921-f1a7-52b2-93bb-1880f80d2236 with scrape type 2
2026-03-29 20:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1e398921-f1a7-52b2-93bb-1880f80d2236, identifier: GM68229
2026-03-29 20:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229
2026-03-29 20:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229
2026-03-29 20:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229 to the API
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:42:35Z',
 'fuel_type': 'petrol',
 'id': '1e398921-f1a7-52b2-93bb-1880f80d2236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM68229',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 234107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Saving data for GM68229: {'auction_closing_time': 1774885355.0, 'created_time': 1774729939.211768, 'last_price_update_time': 1774816350.826539}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM68229') HTTP/1.1" 204 0
2026-03-29 20:32:30 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for LK30146: 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for UA37218: 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for NZ75648: 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for ER91021: 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for EM88075: 0
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 20:32:30 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [auto1.be] INFO: Scrape type for UV16393: 2
2026-03-29 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393
2026-03-29 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with scrape type 2
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with scrape type 2
2026-03-29 20:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f, identifier: UV16393
2026-03-29 20:32:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393
2026-03-29 20:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393
2026-03-29 20:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393 to the API
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:20:45Z',
 'fuel_type': 'diesel',
 'id': '4aa19d84-0bd7-5397-9a69-d121b13f1a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV16393',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 121286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-19',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2014}
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Saving data for UV16393: {'auction_closing_time': 1774884045.0, 'created_time': 1774729941.976499, 'last_price_update_time': 1774816351.650549}
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV16393') HTTP/1.1" 204 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for AY92488: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for RL22884: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for WH35268: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for DZ29736: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for ZN30582: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for DW89604: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for JB30712: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for XK23104: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for SG83875: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for UM29446: 0
2026-03-29 20:32:31 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-29 20:32:31 [auto1.be] INFO: Scrape type for XS20349: 2
2026-03-29 20:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349
2026-03-29 20:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with scrape type 2
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with scrape type 2
2026-03-29 20:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4682f7ee-2454-50d6-8255-6ee32f89f0d4, identifier: XS20349
2026-03-29 20:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349
2026-03-29 20:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349
2026-03-29 20:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349 to the API
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'petrol',
 'id': '4682f7ee-2454-50d6-8255-6ee32f89f0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS20349',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 128558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-03',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Saving data for XS20349: {'auction_closing_time': 1774885299.0, 'created_time': 1774729932.849263, 'last_price_update_time': 1774816352.29716}
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS20349') HTTP/1.1" 204 0
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Scrape type for TA24587: 2
2026-03-29 20:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587
2026-03-29 20:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa172659-02ea-5472-9b78-a1927b8042af with scrape type 2
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa172659-02ea-5472-9b78-a1927b8042af with scrape type 2
2026-03-29 20:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa172659-02ea-5472-9b78-a1927b8042af, identifier: TA24587
2026-03-29 20:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587
2026-03-29 20:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587
2026-03-29 20:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587 to the API
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'diesel',
 'id': 'fa172659-02ea-5472-9b78-a1927b8042af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA24587',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 133000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2017}
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Saving data for TA24587: {'auction_closing_time': 1774883944.0, 'created_time': 1774729937.700695, 'last_price_update_time': 1774816352.747625}
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA24587') HTTP/1.1" 204 0
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Scrape type for MM51411: 0
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Scrape type for EM05161: 0
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Scrape type for DP44577: 0
2026-03-29 20:32:32 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [auto1.be] INFO: Scrape type for KU92863: 2
2026-03-29 20:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863
2026-03-29 20:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2b04e0-a58a-5b95-b9db-290f8629daa3 with scrape type 2
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb2b04e0-a58a-5b95-b9db-290f8629daa3 with scrape type 2
2026-03-29 20:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb2b04e0-a58a-5b95-b9db-290f8629daa3, identifier: KU92863
2026-03-29 20:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863
2026-03-29 20:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863
2026-03-29 20:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863 to the API
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:14Z',
 'fuel_type': 'diesel',
 'id': 'cb2b04e0-a58a-5b95-b9db-290f8629daa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU92863',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 209006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-11',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2011}
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [auto1.be] INFO: Saving data for KU92863: {'auction_closing_time': 1774886234.0, 'created_time': 1774729942.863435, 'last_price_update_time': 1774816353.220944}
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU92863') HTTP/1.1" 204 0
2026-03-29 20:32:33 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [auto1.be] INFO: Scrape type for XU79591: 2
2026-03-29 20:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591
2026-03-29 20:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0129a20-c7cd-5be9-9e10-19e70ec33f76 with scrape type 2
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0129a20-c7cd-5be9-9e10-19e70ec33f76 with scrape type 2
2026-03-29 20:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0129a20-c7cd-5be9-9e10-19e70ec33f76, identifier: XU79591
2026-03-29 20:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591
2026-03-29 20:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591
2026-03-29 20:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591 to the API
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:08Z',
 'fuel_type': 'petrol',
 'id': 'd0129a20-c7cd-5be9-9e10-19e70ec33f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU79591',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 138734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [auto1.be] INFO: Saving data for XU79591: {'auction_closing_time': 1774886168.0, 'created_time': 1774001880.760963, 'last_price_update_time': 1774816353.598523}
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU79591') HTTP/1.1" 204 0
2026-03-29 20:32:33 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [auto1.be] INFO: Scrape type for LM11563: 2
2026-03-29 20:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563
2026-03-29 20:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcac546b-4965-5ea5-95cb-dd8d70f8833f with scrape type 2
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcac546b-4965-5ea5-95cb-dd8d70f8833f with scrape type 2
2026-03-29 20:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fcac546b-4965-5ea5-95cb-dd8d70f8833f, identifier: LM11563
2026-03-29 20:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563
2026-03-29 20:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563
2026-03-29 20:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563 to the API
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:30:48Z',
 'fuel_type': 'petrol',
 'id': 'fcac546b-4965-5ea5-95cb-dd8d70f8833f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM11563',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 115488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-07',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [auto1.be] INFO: Saving data for LM11563: {'auction_closing_time': 1774884648.0, 'created_time': 1774729942.375647, 'last_price_update_time': 1774816353.957398}
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM11563') HTTP/1.1" 204 0
2026-03-29 20:32:33 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [auto1.be] INFO: Scrape type for VZ26705: 0
2026-03-29 20:32:33 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for GW19918: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for UY14877: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:34 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for GN49517: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for BE30988: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for LA99224: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for GJ36560: 2
2026-03-29 20:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560
2026-03-29 20:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with scrape type 2
2026-03-29 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with scrape type 2
2026-03-29 20:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9660a33-5bf1-57d7-9178-aabb1a7e72b9, identifier: GJ36560
2026-03-29 20:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560
2026-03-29 20:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560
2026-03-29 20:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560 to the API
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:34Z',
 'fuel_type': 'diesel',
 'id': 'c9660a33-5bf1-57d7-9178-aabb1a7e72b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ36560',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 203973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
 'transmission': 'manual',
 'trim': 'Driver M',
 'year': 2022}
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Saving data for GJ36560: {'auction_closing_time': 1774884274.0, 'created_time': 1773349269.031738, 'last_price_update_time': 1774816354.737971}
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ36560') HTTP/1.1" 204 0
2026-03-29 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for ER36240: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for SD86163: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for BT92464: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for KG93945: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for HJ19751: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for JJ70860: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for JR09444: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-29 20:32:34 [auto1.be] INFO: Scrape type for ET82729: 0
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 20:32:34 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-29 20:32:35 [auto1.be] INFO: Scrape type for HL00392: 0
2026-03-29 20:32:35 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 20:32:35 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-29 20:32:35 [auto1.be] INFO: Scrape type for AU29077: 0
2026-03-29 20:32:35 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-29 20:32:35 [auto1.be] INFO: Scrape type for FL05782: 0
2026-03-29 20:32:35 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:36 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for UY27001: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for CM21252: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for SU85893: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for DT20121: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for VM76060: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for TJ00131: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for VY36246: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for MJ04907: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for YG03175: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for UG65181: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for KT35610: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for GH80996: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for ZY24236: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for ZZ74713: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for XD67660: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for DT55223: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for EL95031: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for UX01518: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for EK14732: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for UR02836: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for VX51166: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [auto1.be] INFO: Scrape type for BD29807: 0
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 20:32:36 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 20:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:32:37 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1260 | hits on page: 40
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for ZJ26009: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for LR36013: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for TX50404: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for HR69689: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for FC15884: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for KX73156: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for CA73486: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for NU74968: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for WX14373: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for SW60531: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for JJ51820: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for KH65741: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for CV58665: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for NE94103: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for RC51689: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-29 20:32:37 [auto1.be] INFO: Scrape type for KB41449: 0
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 20:32:37 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 20:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:33:06 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 7 pages/min), scraped 193 items (at 59 items/min)
2026-03-29 20:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-29 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:33:08 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1260 | hits on page: 40
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for JU94491: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for PU93740: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for GV92885: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for DV83163: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for AF15006: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for JY19882: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for JZ80953: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for TL44110: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for FC31614: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for CU06988: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-29 20:33:08 [auto1.be] INFO: Scrape type for KH04328: 0
2026-03-29 20:33:08 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-29 20:33:09 [auto1.be] INFO: Scrape type for GN32494: 0
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-29 20:33:09 [auto1.be] INFO: Scrape type for LA84805: 0
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-29 20:33:09 [auto1.be] INFO: Scrape type for RX31058: 0
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-29 20:33:09 [auto1.be] INFO: Scrape type for BB55914: 0
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-29 20:33:09 [auto1.be] INFO: Scrape type for KC67497: 0
2026-03-29 20:33:09 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 20:33:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:33:10 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1260 | hits on page: 40
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for US61346: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for SY12350: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for ST29091: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for TV57254: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for RF01360: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for UU14069: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for XG78459: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for RC25321: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for YZ86935: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for XB72565: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for PV46198: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-29 20:33:10 [auto1.be] INFO: Scrape type for XX22473: 0
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 20:33:10 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 20:33:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:33:11 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1260 | hits on page: 20
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for YA99172: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for PD03709: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for WY04920: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for SJ57770: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 20:33:11 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-29 20:33:11 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-29 20:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:33:12 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1260 | hits on page: 0
2026-03-29 20:33:12 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 20:33:12 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-29 20:33:12 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 92, <ScrapeType.BATCH_SKIPPED: 5>: 120}
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774384392 HTTP/1.1" 200 None
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AA42010') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AB33233') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AC90466') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AD83507') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AD99430') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AE58446') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AG15556') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AH76783') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AL01251') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AM93642') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AP02164') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AR40934') HTTP/1.1" 204 0
2026-03-29 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AT19224') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AV77848') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AY87548') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AZ01896') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AZ05381') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AZ37219') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BB46749') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BC22985') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BC27058') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BD37457') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BH83667') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ09578') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ12931') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BK21297') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BL35335') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BP62134') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ38537') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CF03599') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CF52594') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CK22652') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CS98041') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CZ48084') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DB09653') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DC64633') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DF90944') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ57966') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ61365') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DK47490') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DK53575') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DR08264') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DS87522') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DU27882') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DW80932') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EE56282') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EK17214') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EK78236') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EL44117') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EL70266') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EN23931') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ER70694') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EY10486') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ16808') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ41319') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FB11104') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FC43481') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FE15096') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FE84790') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ87785') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FK03053') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FL12658') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FL59951') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FN89349') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FN89507') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GA37296') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GB16204') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GE69163') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GE95445') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ92162') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GK89271') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GL51024') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GN58348') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GR24264') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GS46591') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GV26071') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GV46258') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GX72100') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HH64606') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ01873') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HP12007') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HR22801') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HW43173') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HX74523') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HY43533') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ59886') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JA00540') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JA60978') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JK78609') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JL25149') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JU31319') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KC29177') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KC51288') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KG16789') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KG62115') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KH55055') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KH67328') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KJ71773') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KK98916') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KN13708') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KN47793') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KP37607') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KV03565') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KX98376') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KY22061') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KY66334') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ25334') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LC97090') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LD75191') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LL67173') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LT93793') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LV14659') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LW97177') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LX04581') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ19697') HTTP/1.1" 204 0
2026-03-29 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ38805') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MC77559') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ME39746') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MK43938') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MM41481') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MN35524') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MN88491') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MU33370') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MW22693') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ83938') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NA49991') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NC34095') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NH86251') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NT40515') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NY25941') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ33792') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PA03002') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PC90148') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PE48575') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PE60276') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PF05819') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PF65153') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PK34450') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PS38215') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PS84685') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PV56982') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PV83093') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PW09723') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ91565') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RF23886') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RN12926') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RP81376') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RR21200') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RS80752') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RT21271') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RU91413') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RV11095') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RW34527') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RW57501') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SB82513') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SC48774') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SE38004') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SF80629') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SG50076') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SG75924') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SM69454') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SP21150') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SP33076') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SS13285') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SS64813') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SW57705') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ21168') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TA19185') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TA95531') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TA95934') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TF14331') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TK89917') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TL44622') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TN97824') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TU50436') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TV54505') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TW84362') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UB38027') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UD24749') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UG34340') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UK90242') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UL93037') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UR44482') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UT02007') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UT07561') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UU28217') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UX23912') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UX87308') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UY52738') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VA46909') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VC53176') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VK28376') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VK40214') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VN12855') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VN31244') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP17023') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP95014') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VR76359') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VV15197') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VV64303') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ61063') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WB90977') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WC65913') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WG31276') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WG79514') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WH75082') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WH87909') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ68361') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ99637') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WW31981') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WY46592') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XF41522') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XF65435') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XH43252') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XH91575') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XY25350') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XY44449') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ41568') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YA22217') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YD64670') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YH70844') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YH86168') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YN14626') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YN29778') HTTP/1.1" 204 0
2026-03-29 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YN56945') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YS89151') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YU19020') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YV19532') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YX44943') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZE99287') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF29136') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH30880') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS13918') HTTP/1.1" 204 0
2026-03-29 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT68914') HTTP/1.1" 204 0
2026-03-29 20:33:15 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (193 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-29T20_30_00.jl
2026-03-29 20:33:15 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 102369,
 'downloader/request_count': 37,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 35,
 'downloader/response_bytes': 5947818,
 'downloader/response_count': 37,
 'downloader/response_status_count/200': 37,
 'elapsed_time_seconds': 188.301525,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 20, 33, 15, 70425, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 193,
 'log_count/DEBUG': 3020,
 'log_count/INFO': 3594,
 'memusage/max': 167473152,
 'memusage/startup': 149639168,
 'request_depth_max': 36,
 'response_received_count': 37,
 'scheduler/dequeued': 37,
 'scheduler/dequeued/memory': 37,
 'scheduler/enqueued': 37,
 'scheduler/enqueued/memory': 37,
 'scrape_type/batch_skipped': 647,
 'scrape_type/price_update': 193,
 'scrape_type/skipped': 460,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 37,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.909502510157591,
 'scrapy-zyte-api/mean_response_seconds': 3.999087772168521,
 'scrapy-zyte-api/processed': 37,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 37,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 36,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 37,
 'scrapy-zyte-api/request_args/httpRequestBody': 35,
 'scrapy-zyte-api/request_args/httpRequestMethod': 35,
 'scrapy-zyte-api/request_args/httpResponseBody': 37,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 37,
 'scrapy-zyte-api/request_args/sessionContext': 37,
 'scrapy-zyte-api/request_args/url': 37,
 'scrapy-zyte-api/status_codes/200': 37,
 'scrapy-zyte-api/success': 37,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1300,
 'source/total_available': 1260,
 'start_time': datetime.datetime(2026, 3, 29, 20, 30, 6, 768900, tzinfo=datetime.timezone.utc)}
2026-03-29 20:33:15 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 20:33:15 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f284962dcd0>
2026-03-29 20:33:15 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f284977fa10>