2026-03-29 06:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 06:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 06:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-29 06:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 06:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 06:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 06:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 06:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 06:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: cb4411ee0259254a
2026-03-29 06:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 06:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-29T06_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 06:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 06:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 06:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 06:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 06:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 06:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-29 06:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 06:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 06:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 06:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 06:30:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 06:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 06:30:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 06:30:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 06:30:07 [scrapy.core.engine] INFO: Spider opened
2026-03-29 06:30:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 06:30:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 06:30:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 06:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 06:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 06:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 06:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 06:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for CE14127: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for NH43704: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for XM15621: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for FM14350: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for FY63763: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for SZ16034: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for FP25504: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for BX88810: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for PD85961: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-29 06:30:16 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-29 06:30:16 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-29 06:30:17 [auto1.be] INFO: Scrape type for EA25293: 2
2026-03-29 06:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-29 06:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with scrape type 2
2026-03-29 06:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with scrape type 2
2026-03-29 06:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae, identifier: EA25293
2026-03-29 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-29 06:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293 to the API
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:14:52Z',
 'fuel_type': 'petrol',
 'id': '48cb7c2b-fc61-55e8-8315-8bc240ab5aae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA25293',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 123744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-03',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-29 06:30:17 [auto1.be] INFO: Saving data for EA25293: {'auction_closing_time': 1774883692.0, 'created_time': 1774643618.56467, 'last_price_update_time': 1774765817.707531}
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA25293') HTTP/1.1" 204 0
2026-03-29 06:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:17 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 06:30:17 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 06:30:17 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-29 06:30:17 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-29 06:30:17 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 06:30:17 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-29 06:30:17 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-29 06:30:17 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 06:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:18 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:18 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 06:30:18 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-29 06:30:18 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-29 06:30:18 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 06:30:18 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for CE14127: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for NH43704: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for XM15621: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for FM14350: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for FY63763: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for SZ16034: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for FP25504: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for BX88810: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for PD85961: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-29 06:30:19 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-29 06:30:19 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 06:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:20 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for TX45109: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-29 06:30:20 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-29 06:30:20 [auto1.be] INFO: Scrape type for CX99155: 2
2026-03-29 06:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-29 06:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 with scrape type 2
2026-03-29 06:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 with scrape type 2
2026-03-29 06:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07109768-a8fd-50b0-91e3-aeb2061c4d22, identifier: CX99155
2026-03-29 06:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 06:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 06:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-29 06:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155 to the API
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:07:49Z',
 'fuel_type': 'diesel',
 'id': '07109768-a8fd-50b0-91e3-aeb2061c4d22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX99155',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 230408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-04',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-29 06:30:22 [auto1.be] INFO: Saving data for CX99155: {'auction_closing_time': 1774883269.0, 'created_time': 1774643610.708655, 'last_price_update_time': 1774765822.02657}
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX99155') HTTP/1.1" 204 0
2026-03-29 06:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:22 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 06:30:22 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 06:30:22 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 06:30:22 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-29 06:30:22 [auto1.be] INFO: Scrape type for HS59761: 2
2026-03-29 06:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-29 06:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with scrape type 2
2026-03-29 06:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with scrape type 2
2026-03-29 06:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f, identifier: HS59761
2026-03-29 06:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-29 06:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-29 06:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761 to the API
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:32:51Z',
 'fuel_type': 'diesel',
 'id': '3fd75480-87a9-57c0-b2a5-e785c4c31e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS59761',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 72994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-12',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-29 06:30:22 [auto1.be] INFO: Saving data for HS59761: {'auction_closing_time': 1774884771.0, 'created_time': 1774643497.148986, 'last_price_update_time': 1774765822.683861}
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS59761') HTTP/1.1" 204 0
2026-03-29 06:30:22 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-29 06:30:22 [auto1.be] INFO: Scrape type for LZ48262: 2
2026-03-29 06:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-29 06:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a640e348-1bde-5834-9365-38be7c082299 with scrape type 2
2026-03-29 06:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a640e348-1bde-5834-9365-38be7c082299 with scrape type 2
2026-03-29 06:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a640e348-1bde-5834-9365-38be7c082299, identifier: LZ48262
2026-03-29 06:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 06:30:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-29 06:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262 to the API
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:24:01Z',
 'fuel_type': 'petrol',
 'id': 'a640e348-1bde-5834-9365-38be7c082299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ48262',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 41785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-14',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech YOU',
 'transmission': 'manual',
 'trim': 'YOU',
 'year': 2024}
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-29 06:30:23 [auto1.be] INFO: Saving data for LZ48262: {'auction_closing_time': 1774884241.0, 'created_time': 1773301711.523556, 'last_price_update_time': 1774765823.298596}
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ48262') HTTP/1.1" 204 0
2026-03-29 06:30:23 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-29 06:30:23 [auto1.be] INFO: Scrape type for RM46702: 2
2026-03-29 06:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-29 06:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0e1375-1c24-52fe-bef3-32e29d915a60 with scrape type 2
2026-03-29 06:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0e1375-1c24-52fe-bef3-32e29d915a60 with scrape type 2
2026-03-29 06:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc0e1375-1c24-52fe-bef3-32e29d915a60, identifier: RM46702
2026-03-29 06:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 06:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-29 06:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702 to the API
2026-03-29 06:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:09:26Z',
 'fuel_type': 'petrol',
 'id': 'dc0e1375-1c24-52fe-bef3-32e29d915a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM46702',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 87002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Saving data for RM46702: {'auction_closing_time': 1774883366.0, 'created_time': 1774557088.897698, 'last_price_update_time': 1774765824.63749}
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM46702') HTTP/1.1" 204 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-29 06:30:24 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-29 06:30:24 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 06:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:25 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:25 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-29 06:30:25 [auto1.be] INFO: Scrape type for XN92471: 2
2026-03-29 06:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-29 06:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 with scrape type 2
2026-03-29 06:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 with scrape type 2
2026-03-29 06:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 84ac1513-66b8-5a90-a85c-273bcb8746f0, identifier: XN92471
2026-03-29 06:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-29 06:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-29 06:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471 to the API
2026-03-29 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:02:31Z',
 'fuel_type': 'petrol',
 'id': '84ac1513-66b8-5a90-a85c-273bcb8746f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN92471',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-23',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-29 06:30:27 [auto1.be] INFO: Saving data for XN92471: {'auction_closing_time': 1774882951.0, 'created_time': 1774643617.196526, 'last_price_update_time': 1774765827.106549}
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN92471') HTTP/1.1" 204 0
2026-03-29 06:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-29 06:30:27 [auto1.be] INFO: Scrape type for CK14854: 2
2026-03-29 06:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-29 06:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b3182c-01b0-545d-a767-c318b1ff4838 with scrape type 2
2026-03-29 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b3182c-01b0-545d-a767-c318b1ff4838 with scrape type 2
2026-03-29 06:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17b3182c-01b0-545d-a767-c318b1ff4838, identifier: CK14854
2026-03-29 06:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 06:30:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-29 06:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854 to the API
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:49Z',
 'fuel_type': 'petrol',
 'id': '17b3182c-01b0-545d-a767-c318b1ff4838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK14854',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 171817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Gold',
 'transmission': 'automatic',
 'trim': 'Gold',
 'year': 2014}
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-29 06:30:27 [auto1.be] INFO: Saving data for CK14854: {'auction_closing_time': 1774885249.0, 'created_time': 1773822664.508962, 'last_price_update_time': 1774765827.842832}
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK14854') HTTP/1.1" 204 0
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-29 06:30:27 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-29 06:30:27 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-29 06:30:27 [auto1.be] INFO: Scrape type for EX56301: 2
2026-03-29 06:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-29 06:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055508f5-57f2-543a-a3ef-afee25bf24ad with scrape type 2
2026-03-29 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 055508f5-57f2-543a-a3ef-afee25bf24ad with scrape type 2
2026-03-29 06:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 055508f5-57f2-543a-a3ef-afee25bf24ad, identifier: EX56301
2026-03-29 06:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-29 06:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-29 06:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301 to the API
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:20Z',
 'fuel_type': 'diesel',
 'id': '055508f5-57f2-543a-a3ef-afee25bf24ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX56301',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 134900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2017}
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-29 06:30:28 [auto1.be] INFO: Saving data for EX56301: {'auction_closing_time': 1774884980.0, 'created_time': 1774643657.861915, 'last_price_update_time': 1774765828.379087}
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX56301') HTTP/1.1" 204 0
2026-03-29 06:30:28 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-29 06:30:28 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-29 06:30:28 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 06:30:28 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 06:30:28 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-29 06:30:28 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-29 06:30:28 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-29 06:30:28 [auto1.be] INFO: Scrape type for PB67516: 2
2026-03-29 06:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-29 06:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f34dfec1-d751-59e7-972b-8aecf26a3c83 with scrape type 2
2026-03-29 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f34dfec1-d751-59e7-972b-8aecf26a3c83 with scrape type 2
2026-03-29 06:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f34dfec1-d751-59e7-972b-8aecf26a3c83, identifier: PB67516
2026-03-29 06:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-29 06:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-29 06:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516 to the API
2026-03-29 06:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'diesel',
 'id': 'f34dfec1-d751-59e7-972b-8aecf26a3c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB67516',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 312233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Combi L2H1 2,9t',
 'year': 2017}
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-29 06:30:29 [auto1.be] INFO: Saving data for PB67516: {'auction_closing_time': 1774884856.0, 'created_time': 1773779950.412741, 'last_price_update_time': 1774765829.784989}
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB67516') HTTP/1.1" 204 0
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-29 06:30:29 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-29 06:30:29 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-29 06:30:29 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-29 06:30:29 [auto1.be] INFO: Scrape type for FB34577: 0
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 06:30:29 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-29 06:30:29 [auto1.be] INFO: Scrape type for KP74596: 2
2026-03-29 06:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-29 06:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with scrape type 2
2026-03-29 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with scrape type 2
2026-03-29 06:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648, identifier: KP74596
2026-03-29 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-29 06:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596 to the API
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:11:50Z',
 'fuel_type': 'petrol',
 'id': '81029d9f-3bc6-57b9-aff2-c5b6c81c5648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP74596',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 143314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2014}
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-29 06:30:30 [auto1.be] INFO: Saving data for KP74596: {'auction_closing_time': 1774883510.0, 'created_time': 1773747412.202757, 'last_price_update_time': 1774765830.656294}
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP74596') HTTP/1.1" 204 0
2026-03-29 06:30:30 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 06:30:30 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 06:30:30 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 06:30:30 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-29 06:30:30 [auto1.be] INFO: Scrape type for BN63741: 2
2026-03-29 06:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-29 06:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with scrape type 2
2026-03-29 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with scrape type 2
2026-03-29 06:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e36d345a-bd0c-58ee-b38f-cae5980cf0a6, identifier: BN63741
2026-03-29 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-29 06:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-29 06:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741 to the API
2026-03-29 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:17:53Z',
 'fuel_type': 'petrol',
 'id': 'e36d345a-bd0c-58ee-b38f-cae5980cf0a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN63741',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 13380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-07',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-29 06:30:31 [auto1.be] INFO: Saving data for BN63741: {'auction_closing_time': 1774883873.0, 'created_time': 1774557027.861188, 'last_price_update_time': 1774765831.472209}
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BN63741') HTTP/1.1" 204 0
2026-03-29 06:30:31 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 06:30:31 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-29 06:30:31 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-29 06:30:31 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-29 06:30:31 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-29 06:30:31 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 06:30:31 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-29 06:30:31 [auto1.be] INFO: Scrape type for RA46458: 2
2026-03-29 06:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-29 06:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f290f3-de57-56c0-9027-f8b5471ec80e with scrape type 2
2026-03-29 06:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f290f3-de57-56c0-9027-f8b5471ec80e with scrape type 2
2026-03-29 06:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7f290f3-de57-56c0-9027-f8b5471ec80e, identifier: RA46458
2026-03-29 06:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-29 06:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-29 06:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458 to the API
2026-03-29 06:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:45Z',
 'fuel_type': 'petrol',
 'id': 'b7f290f3-de57-56c0-9027-f8b5471ec80e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA46458',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 85225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2000}
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-29 06:30:32 [auto1.be] INFO: Saving data for RA46458: {'auction_closing_time': 1774883685.0, 'created_time': 1774643646.887681, 'last_price_update_time': 1774765832.394418}
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA46458') HTTP/1.1" 204 0
2026-03-29 06:30:32 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 06:30:32 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 06:30:32 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-29 06:30:32 [auto1.be] INFO: Scrape type for HP14917: 2
2026-03-29 06:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-29 06:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with scrape type 2
2026-03-29 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with scrape type 2
2026-03-29 06:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de, identifier: HP14917
2026-03-29 06:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-29 06:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-29 06:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917 to the API
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:02:14Z',
 'fuel_type': 'diesel',
 'id': '808abb3b-0ea3-5f95-8e22-e7eaed99a6de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP14917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 170964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-29 06:30:32 [auto1.be] INFO: Saving data for HP14917: {'auction_closing_time': 1774882934.0, 'created_time': 1773747710.539213, 'last_price_update_time': 1774765832.850431}
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP14917') HTTP/1.1" 204 0
2026-03-29 06:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:32 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-29 06:30:32 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-29 06:30:32 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-29 06:30:32 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-29 06:30:32 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-29 06:30:33 [auto1.be] INFO: Scrape type for UL34611: 2
2026-03-29 06:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-29 06:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e3db12-67b8-50d3-92db-458c0c76c2d8 with scrape type 2
2026-03-29 06:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e3db12-67b8-50d3-92db-458c0c76c2d8 with scrape type 2
2026-03-29 06:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5e3db12-67b8-50d3-92db-458c0c76c2d8, identifier: UL34611
2026-03-29 06:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 06:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-29 06:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611 to the API
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:42:13Z',
 'fuel_type': 'hybrid',
 'id': 'c5e3db12-67b8-50d3-92db-458c0c76c2d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL34611',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 175078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription Expression '
          '2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2022}
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-29 06:30:33 [auto1.be] INFO: Saving data for UL34611: {'auction_closing_time': 1774885333.0, 'created_time': 1773301757.745511, 'last_price_update_time': 1774765833.51328}
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL34611') HTTP/1.1" 204 0
2026-03-29 06:30:33 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-29 06:30:33 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-29 06:30:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:33 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 06:30:33 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-29 06:30:33 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-29 06:30:33 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-29 06:30:33 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-29 06:30:33 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-29 06:30:33 [auto1.be] INFO: Scrape type for RH88749: 2
2026-03-29 06:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-29 06:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with scrape type 2
2026-03-29 06:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with scrape type 2
2026-03-29 06:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd, identifier: RH88749
2026-03-29 06:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-29 06:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-29 06:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749 to the API
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:07:39Z',
 'fuel_type': 'diesel',
 'id': '1c8d90b4-4d1c-5e19-b032-06761a4fd7fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH88749',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 273273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-29',
 'seller_name': None,
 'title': 'Citroen C1 1.4 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2006}
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-29 06:30:34 [auto1.be] INFO: Saving data for RH88749: {'auction_closing_time': 1774883259.0, 'created_time': 1774557093.65814, 'last_price_update_time': 1774765834.028108}
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH88749') HTTP/1.1" 204 0
2026-03-29 06:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:34 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-29 06:30:34 [auto1.be] INFO: Scrape type for LE66186: 2
2026-03-29 06:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-29 06:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc with scrape type 2
2026-03-29 06:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc with scrape type 2
2026-03-29 06:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23aa2eef-18fc-549f-9d8d-d4675e7addbc, identifier: LE66186
2026-03-29 06:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-29 06:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-29 06:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186 to the API
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:25Z',
 'fuel_type': 'diesel',
 'id': '23aa2eef-18fc-549f-9d8d-d4675e7addbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE66186',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 250246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-29 06:30:34 [auto1.be] INFO: Saving data for LE66186: {'auction_closing_time': 1774884565.0, 'created_time': 1774643650.447888, 'last_price_update_time': 1774765834.46008}
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE66186') HTTP/1.1" 204 0
2026-03-29 06:30:34 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-29 06:30:34 [auto1.be] INFO: Scrape type for RK42644: 2
2026-03-29 06:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-29 06:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with scrape type 2
2026-03-29 06:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with scrape type 2
2026-03-29 06:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435, identifier: RK42644
2026-03-29 06:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-29 06:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-29 06:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644 to the API
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:01Z',
 'fuel_type': 'diesel',
 'id': '3ccf5a2e-b5a8-5937-8bc2-d593eb497435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK42644',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 168399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2011}
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-29 06:30:34 [auto1.be] INFO: Saving data for RK42644: {'auction_closing_time': 1774885621.0, 'created_time': 1774643488.360626, 'last_price_update_time': 1774765834.867783}
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK42644') HTTP/1.1" 204 0
2026-03-29 06:30:34 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-29 06:30:35 [auto1.be] INFO: Scrape type for AP73624: 2
2026-03-29 06:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-29 06:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55397c6-6523-538d-8401-e93bcfbe5d68 with scrape type 2
2026-03-29 06:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55397c6-6523-538d-8401-e93bcfbe5d68 with scrape type 2
2026-03-29 06:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c55397c6-6523-538d-8401-e93bcfbe5d68, identifier: AP73624
2026-03-29 06:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-29 06:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-29 06:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624 to the API
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:26:52Z',
 'fuel_type': 'petrol',
 'id': 'c55397c6-6523-538d-8401-e93bcfbe5d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP73624',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 139592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2019}
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-29 06:30:35 [auto1.be] INFO: Saving data for AP73624: {'auction_closing_time': 1774884412.0, 'created_time': 1774557096.785178, 'last_price_update_time': 1774765835.385222}
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP73624') HTTP/1.1" 204 0
2026-03-29 06:30:35 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 06:30:35 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-29 06:30:35 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-29 06:30:35 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-29 06:30:35 [auto1.be] INFO: Scrape type for DW87206: 2
2026-03-29 06:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-29 06:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219a16b6-d815-5fa2-9c5a-28a2605538df with scrape type 2
2026-03-29 06:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219a16b6-d815-5fa2-9c5a-28a2605538df with scrape type 2
2026-03-29 06:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 219a16b6-d815-5fa2-9c5a-28a2605538df, identifier: DW87206
2026-03-29 06:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-29 06:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-29 06:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206 to the API
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:41Z',
 'fuel_type': 'diesel',
 'id': '219a16b6-d815-5fa2-9c5a-28a2605538df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW87206',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 169340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'BMW 2er 218d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-29 06:30:35 [auto1.be] INFO: Saving data for DW87206: {'auction_closing_time': 1774886261.0, 'created_time': 1774643652.173748, 'last_price_update_time': 1774765835.925351}
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW87206') HTTP/1.1" 204 0
2026-03-29 06:30:35 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-29 06:30:35 [auto1.be] INFO: Scrape type for NY99560: 2
2026-03-29 06:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-29 06:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75c4c57-ac4b-5311-a0db-e58a108023d4 with scrape type 2
2026-03-29 06:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75c4c57-ac4b-5311-a0db-e58a108023d4 with scrape type 2
2026-03-29 06:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f75c4c57-ac4b-5311-a0db-e58a108023d4, identifier: NY99560
2026-03-29 06:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-29 06:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-29 06:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560 to the API
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'hybrid',
 'id': 'f75c4c57-ac4b-5311-a0db-e58a108023d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY99560',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Saving data for NY99560: {'auction_closing_time': 1774884503.0, 'created_time': 1774643654.321706, 'last_price_update_time': 1774765836.334068}
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY99560') HTTP/1.1" 204 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for NG50909: 2
2026-03-29 06:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-29 06:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218f08b8-69a8-597a-92d9-597c477a7aa8 with scrape type 2
2026-03-29 06:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 218f08b8-69a8-597a-92d9-597c477a7aa8 with scrape type 2
2026-03-29 06:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 218f08b8-69a8-597a-92d9-597c477a7aa8, identifier: NG50909
2026-03-29 06:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-29 06:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-29 06:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909 to the API
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:24:14Z',
 'fuel_type': 'petrol',
 'id': '218f08b8-69a8-597a-92d9-597c477a7aa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50909',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 146103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-20',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Saving data for NG50909: {'auction_closing_time': 1774884254.0, 'created_time': 1773137745.388471, 'last_price_update_time': 1774765836.79822}
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG50909') HTTP/1.1" 204 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 06:30:36 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-29 06:30:36 [auto1.be] INFO: Scrape type for VW32861: 2
2026-03-29 06:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-29 06:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a816a3a2-a052-5345-8f53-a1206ac57403 with scrape type 2
2026-03-29 06:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a816a3a2-a052-5345-8f53-a1206ac57403 with scrape type 2
2026-03-29 06:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a816a3a2-a052-5345-8f53-a1206ac57403, identifier: VW32861
2026-03-29 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-29 06:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-29 06:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861 to the API
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'hybrid',
 'id': 'a816a3a2-a052-5345-8f53-a1206ac57403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW32861',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 50169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2017}
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Saving data for VW32861: {'auction_closing_time': 1774883065.0, 'created_time': 1774643481.780312, 'last_price_update_time': 1774765837.342897}
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW32861') HTTP/1.1" 204 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for AK54797: 2
2026-03-29 06:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-29 06:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4862eee9-488b-5df7-afbe-2532b1169169 with scrape type 2
2026-03-29 06:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4862eee9-488b-5df7-afbe-2532b1169169 with scrape type 2
2026-03-29 06:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4862eee9-488b-5df7-afbe-2532b1169169, identifier: AK54797
2026-03-29 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-29 06:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-29 06:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797 to the API
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:24:15Z',
 'fuel_type': 'diesel',
 'id': '4862eee9-488b-5df7-afbe-2532b1169169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK54797',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 113656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2021}
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Saving data for AK54797: {'auction_closing_time': 1774884255.0, 'created_time': 1774557066.316145, 'last_price_update_time': 1774765837.940188}
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK54797') HTTP/1.1" 204 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-29 06:30:37 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-29 06:30:37 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-29 06:30:38 [auto1.be] INFO: Scrape type for DY69036: 2
2026-03-29 06:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-29 06:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19a411a-5376-51bb-adec-fa5662b5b79f with scrape type 2
2026-03-29 06:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e19a411a-5376-51bb-adec-fa5662b5b79f with scrape type 2
2026-03-29 06:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e19a411a-5376-51bb-adec-fa5662b5b79f, identifier: DY69036
2026-03-29 06:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 06:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-29 06:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036 to the API
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:36:25Z',
 'fuel_type': 'diesel',
 'id': 'e19a411a-5376-51bb-adec-fa5662b5b79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY69036',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 188759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-16',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-29 06:30:38 [auto1.be] INFO: Saving data for DY69036: {'auction_closing_time': 1774884985.0, 'created_time': 1774643649.750288, 'last_price_update_time': 1774765838.495103}
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY69036') HTTP/1.1" 204 0
2026-03-29 06:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:45 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-29 06:30:45 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-29 06:30:45 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-29 06:30:45 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-29 06:30:45 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-29 06:30:45 [auto1.be] INFO: Scrape type for LA76788: 2
2026-03-29 06:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-29 06:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with scrape type 2
2026-03-29 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with scrape type 2
2026-03-29 06:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640, identifier: LA76788
2026-03-29 06:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-29 06:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-29 06:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788 to the API
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:46:58Z',
 'fuel_type': 'diesel',
 'id': 'b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA76788',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 129227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-04',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2016}
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Saving data for LA76788: {'auction_closing_time': 1774885618.0, 'created_time': 1773866557.317288, 'last_price_update_time': 1774765846.276613}
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA76788') HTTP/1.1" 204 0
2026-03-29 06:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for PL61351: 2
2026-03-29 06:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-29 06:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with scrape type 2
2026-03-29 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with scrape type 2
2026-03-29 06:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a, identifier: PL61351
2026-03-29 06:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-29 06:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-29 06:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351 to the API
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:55Z',
 'fuel_type': 'diesel',
 'id': 'f9ddad94-b6c8-5f03-8a21-5df36bca4e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL61351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 209058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Saving data for PL61351: {'auction_closing_time': 1774883215.0, 'created_time': 1774557242.383892, 'last_price_update_time': 1774765846.82243}
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL61351') HTTP/1.1" 204 0
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 06:30:46 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-29 06:30:46 [auto1.be] INFO: Scrape type for SE12861: 2
2026-03-29 06:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-29 06:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 with scrape type 2
2026-03-29 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 with scrape type 2
2026-03-29 06:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3958b6f2-330e-537a-b8a3-483a87ed7f71, identifier: SE12861
2026-03-29 06:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-29 06:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-29 06:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861 to the API
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:33Z',
 'fuel_type': 'diesel',
 'id': '3958b6f2-330e-537a-b8a3-483a87ed7f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE12861',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 206586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-29 06:30:47 [auto1.be] INFO: Saving data for SE12861: {'auction_closing_time': 1774883133.0, 'created_time': 1774643610.224222, 'last_price_update_time': 1774765847.314762}
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE12861') HTTP/1.1" 204 0
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-29 06:30:47 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-29 06:30:47 [auto1.be] INFO: Scrape type for LJ91533: 2
2026-03-29 06:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-29 06:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7845b786-ced6-52e0-b98e-ad07e24228e2 with scrape type 2
2026-03-29 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7845b786-ced6-52e0-b98e-ad07e24228e2 with scrape type 2
2026-03-29 06:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7845b786-ced6-52e0-b98e-ad07e24228e2, identifier: LJ91533
2026-03-29 06:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-29 06:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-29 06:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533 to the API
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:02:43Z',
 'fuel_type': 'diesel',
 'id': '7845b786-ced6-52e0-b98e-ad07e24228e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ91533',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 249231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-29 06:30:47 [auto1.be] INFO: Saving data for LJ91533: {'auction_closing_time': 1774882963.0, 'created_time': 1774643660.82226, 'last_price_update_time': 1774765847.852628}
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ91533') HTTP/1.1" 204 0
2026-03-29 06:30:47 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-29 06:30:47 [auto1.be] INFO: Scrape type for TY52799: 2
2026-03-29 06:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-29 06:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381d8655-56fb-5dab-ac63-b55d8beb6d0e with scrape type 2
2026-03-29 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 381d8655-56fb-5dab-ac63-b55d8beb6d0e with scrape type 2
2026-03-29 06:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 381d8655-56fb-5dab-ac63-b55d8beb6d0e, identifier: TY52799
2026-03-29 06:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-29 06:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-29 06:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799 to the API
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:58Z',
 'fuel_type': 'diesel',
 'id': '381d8655-56fb-5dab-ac63-b55d8beb6d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY52799',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 133263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-29 06:30:48 [auto1.be] INFO: Saving data for TY52799: {'auction_closing_time': 1774884598.0, 'created_time': 1773866650.163275, 'last_price_update_time': 1774765848.262123}
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY52799') HTTP/1.1" 204 0
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-29 06:30:48 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-29 06:30:48 [auto1.be] INFO: Scrape type for NU46591: 2
2026-03-29 06:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-29 06:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985a2368-356f-5991-b43b-36c54861b5b5 with scrape type 2
2026-03-29 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 985a2368-356f-5991-b43b-36c54861b5b5 with scrape type 2
2026-03-29 06:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 985a2368-356f-5991-b43b-36c54861b5b5, identifier: NU46591
2026-03-29 06:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-29 06:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-29 06:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591 to the API
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-30T15:12:21Z',
 'fuel_type': 'petrol',
 'id': '985a2368-356f-5991-b43b-36c54861b5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU46591',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X7',
 'odometer': 82957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seller_name': None,
 'title': 'BMW X7 M50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-29 06:30:48 [auto1.be] INFO: Saving data for NU46591: {'auction_closing_time': 1774883541.0, 'created_time': 1774643647.550374, 'last_price_update_time': 1774765848.687298}
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU46591') HTTP/1.1" 204 0
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 06:30:48 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-29 06:30:48 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-29 06:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:49 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:49 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 06:30:49 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-29 06:30:49 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-29 06:30:49 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-29 06:30:49 [auto1.be] INFO: Scrape type for CS76215: 2
2026-03-29 06:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-29 06:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with scrape type 2
2026-03-29 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with scrape type 2
2026-03-29 06:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af, identifier: CS76215
2026-03-29 06:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-29 06:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 06:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-29 06:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215 to the API
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'petrol',
 'id': '41cb4f8b-3f47-5e1f-93ef-6b7506c322af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76215',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 115278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-06',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2020}
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-29 06:30:50 [auto1.be] INFO: Saving data for CS76215: {'auction_closing_time': 1774882891.0, 'created_time': 1774557107.100583, 'last_price_update_time': 1774765850.312901}
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS76215') HTTP/1.1" 204 0
2026-03-29 06:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-29 06:30:50 [auto1.be] INFO: Scrape type for WD81319: 2
2026-03-29 06:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-29 06:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with scrape type 2
2026-03-29 06:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with scrape type 2
2026-03-29 06:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349, identifier: WD81319
2026-03-29 06:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-29 06:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-29 06:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319 to the API
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:45:37Z',
 'fuel_type': 'petrol',
 'id': '09ee685d-6fce-52ec-9f94-6ed2aaf8c349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD81319',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 61727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-29 06:30:50 [auto1.be] INFO: Saving data for WD81319: {'auction_closing_time': 1774885537.0, 'created_time': 1774643664.285306, 'last_price_update_time': 1774765850.722418}
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD81319') HTTP/1.1" 204 0
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-29 06:30:50 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 06:30:50 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-29 06:30:50 [auto1.be] INFO: Scrape type for MZ83142: 2
2026-03-29 06:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-29 06:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8dc67b-4464-57eb-8fee-49e21b2fe627 with scrape type 2
2026-03-29 06:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa8dc67b-4464-57eb-8fee-49e21b2fe627 with scrape type 2
2026-03-29 06:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa8dc67b-4464-57eb-8fee-49e21b2fe627, identifier: MZ83142
2026-03-29 06:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-29 06:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-29 06:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142 to the API
2026-03-29 06:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': 'fa8dc67b-4464-57eb-8fee-49e21b2fe627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ83142',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 187766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-29 06:30:51 [auto1.be] INFO: Saving data for MZ83142: {'auction_closing_time': 1774885963.0, 'created_time': 1773866096.224422, 'last_price_update_time': 1774765851.166559}
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ83142') HTTP/1.1" 204 0
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-29 06:30:51 [auto1.be] INFO: Scrape type for CA72484: 2
2026-03-29 06:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-29 06:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d0e83ae-50c5-5e36-a54e-a86862682694 with scrape type 2
2026-03-29 06:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d0e83ae-50c5-5e36-a54e-a86862682694 with scrape type 2
2026-03-29 06:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d0e83ae-50c5-5e36-a54e-a86862682694, identifier: CA72484
2026-03-29 06:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-29 06:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-29 06:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484 to the API
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:07:02Z',
 'fuel_type': 'diesel',
 'id': '4d0e83ae-50c5-5e36-a54e-a86862682694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA72484',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 54019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Live M',
 'transmission': 'manual',
 'trim': 'Live M',
 'year': 2021}
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-29 06:30:51 [auto1.be] INFO: Saving data for CA72484: {'auction_closing_time': 1774883222.0, 'created_time': 1774254701.393151, 'last_price_update_time': 1774765851.678711}
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA72484') HTTP/1.1" 204 0
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-29 06:30:51 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-29 06:30:51 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 06:30:51 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-29 06:30:51 [auto1.be] INFO: Scrape type for YB47559: 2
2026-03-29 06:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-29 06:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c434bced-6124-571a-ab44-4176838b7555 with scrape type 2
2026-03-29 06:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c434bced-6124-571a-ab44-4176838b7555 with scrape type 2
2026-03-29 06:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c434bced-6124-571a-ab44-4176838b7555, identifier: YB47559
2026-03-29 06:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-29 06:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-29 06:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559 to the API
2026-03-29 06:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:10Z',
 'fuel_type': 'diesel',
 'id': 'c434bced-6124-571a-ab44-4176838b7555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB47559',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 184273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-11',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-29 06:30:52 [auto1.be] INFO: Saving data for YB47559: {'auction_closing_time': 1774886170.0, 'created_time': 1773434299.099478, 'last_price_update_time': 1774765852.163609}
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB47559') HTTP/1.1" 204 0
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-29 06:30:52 [auto1.be] INFO: Scrape type for PT26763: 2
2026-03-29 06:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-29 06:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587ea13f-532d-5194-a614-83d6c952f2dc with scrape type 2
2026-03-29 06:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587ea13f-532d-5194-a614-83d6c952f2dc with scrape type 2
2026-03-29 06:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 587ea13f-532d-5194-a614-83d6c952f2dc, identifier: PT26763
2026-03-29 06:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-29 06:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-29 06:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763 to the API
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:17Z',
 'fuel_type': 'diesel',
 'id': '587ea13f-532d-5194-a614-83d6c952f2dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT26763',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 175344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueTEC Avantgarde',
 'year': 2015}
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-29 06:30:52 [auto1.be] INFO: Saving data for PT26763: {'auction_closing_time': 1774884797.0, 'created_time': 1774643626.180468, 'last_price_update_time': 1774765852.593558}
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT26763') HTTP/1.1" 204 0
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-29 06:30:52 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-29 06:30:52 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 06:30:52 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-29 06:30:52 [auto1.be] INFO: Scrape type for PC96861: 2
2026-03-29 06:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-29 06:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3aabd-187e-5b20-b476-734ae3ac1f01 with scrape type 2
2026-03-29 06:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db3aabd-187e-5b20-b476-734ae3ac1f01 with scrape type 2
2026-03-29 06:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1db3aabd-187e-5b20-b476-734ae3ac1f01, identifier: PC96861
2026-03-29 06:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 06:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-29 06:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861 to the API
2026-03-29 06:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:05Z',
 'fuel_type': 'diesel',
 'id': '1db3aabd-187e-5b20-b476-734ae3ac1f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC96861',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 205828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Saving data for PC96861: {'auction_closing_time': 1774884245.0, 'created_time': 1773301753.190102, 'last_price_update_time': 1774765853.188116}
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC96861') HTTP/1.1" 204 0
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-29 06:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:53 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:53 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Scrape type for AM54260: 2
2026-03-29 06:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-29 06:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with scrape type 2
2026-03-29 06:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with scrape type 2
2026-03-29 06:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d77d4183-7921-57e4-9dc2-3fb3d4766ee8, identifier: AM54260
2026-03-29 06:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-29 06:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-29 06:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260 to the API
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:29Z',
 'fuel_type': 'diesel',
 'id': 'd77d4183-7921-57e4-9dc2-3fb3d4766ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM54260',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 203078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-17',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2011}
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-29 06:30:53 [auto1.be] INFO: Saving data for AM54260: {'auction_closing_time': 1774884329.0, 'created_time': 1773909030.335938, 'last_price_update_time': 1774765853.903561}
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM54260') HTTP/1.1" 204 0
2026-03-29 06:30:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for DW89258: 2
2026-03-29 06:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-29 06:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52248d4a-e6ea-5101-8ddf-fea58ffe956a with scrape type 2
2026-03-29 06:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52248d4a-e6ea-5101-8ddf-fea58ffe956a with scrape type 2
2026-03-29 06:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52248d4a-e6ea-5101-8ddf-fea58ffe956a, identifier: DW89258
2026-03-29 06:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-29 06:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-29 06:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258 to the API
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:29:27Z',
 'fuel_type': 'petrol',
 'id': '52248d4a-e6ea-5101-8ddf-fea58ffe956a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89258',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 118026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2018}
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Saving data for DW89258: {'auction_closing_time': 1774884567.0, 'created_time': 1774557026.899328, 'last_price_update_time': 1774765854.490928}
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW89258') HTTP/1.1" 204 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-29 06:30:54 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Scrape type for BA13225: 2
2026-03-29 06:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-29 06:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187da6b3-d1f2-5477-86c4-8669ced36174 with scrape type 2
2026-03-29 06:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187da6b3-d1f2-5477-86c4-8669ced36174 with scrape type 2
2026-03-29 06:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 187da6b3-d1f2-5477-86c4-8669ced36174, identifier: BA13225
2026-03-29 06:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-29 06:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-29 06:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225 to the API
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'petrol',
 'id': '187da6b3-d1f2-5477-86c4-8669ced36174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA13225',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 56773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-29 06:30:54 [auto1.be] INFO: Saving data for BA13225: {'auction_closing_time': 1774884424.0, 'created_time': 1774557221.174339, 'last_price_update_time': 1774765854.987576}
2026-03-29 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA13225') HTTP/1.1" 204 0
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-29 06:30:55 [auto1.be] INFO: Scrape type for HY58683: 2
2026-03-29 06:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-29 06:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with scrape type 2
2026-03-29 06:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with scrape type 2
2026-03-29 06:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc, identifier: HY58683
2026-03-29 06:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-29 06:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-29 06:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683 to the API
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'diesel',
 'id': 'c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY58683',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 272404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-29 06:30:55 [auto1.be] INFO: Saving data for HY58683: {'auction_closing_time': 1774886135.0, 'created_time': 1774643673.265195, 'last_price_update_time': 1774765855.481519}
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY58683') HTTP/1.1" 204 0
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-29 06:30:55 [auto1.be] INFO: Scrape type for NP23299: 2
2026-03-29 06:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-29 06:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with scrape type 2
2026-03-29 06:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with scrape type 2
2026-03-29 06:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72, identifier: NP23299
2026-03-29 06:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-29 06:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-29 06:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299 to the API
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:33Z',
 'fuel_type': 'petrol',
 'id': '7c97d0b5-b7c0-55cc-b081-a6bb755f8a72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP23299',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 58429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-10',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-29 06:30:55 [auto1.be] INFO: Saving data for NP23299: {'auction_closing_time': 1774883013.0, 'created_time': 1773224571.095282, 'last_price_update_time': 1774765855.94212}
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP23299') HTTP/1.1" 204 0
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-29 06:30:55 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-29 06:30:55 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 06:30:55 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-29 06:30:56 [auto1.be] INFO: Scrape type for WJ68976: 2
2026-03-29 06:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-29 06:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0fcadb-0820-5f2b-be46-a8cd384f0249 with scrape type 2
2026-03-29 06:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0fcadb-0820-5f2b-be46-a8cd384f0249 with scrape type 2
2026-03-29 06:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd0fcadb-0820-5f2b-be46-a8cd384f0249, identifier: WJ68976
2026-03-29 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-29 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-29 06:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976 to the API
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:50:13Z',
 'fuel_type': 'petrol',
 'id': 'cd0fcadb-0820-5f2b-be46-a8cd384f0249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ68976',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 50580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-29 06:30:56 [auto1.be] INFO: Saving data for WJ68976: {'auction_closing_time': 1774885813.0, 'created_time': 1774643589.861876, 'last_price_update_time': 1774765856.420771}
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ68976') HTTP/1.1" 204 0
2026-03-29 06:30:56 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-29 06:30:56 [auto1.be] INFO: Scrape type for CS08088: 2
2026-03-29 06:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-29 06:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe1580-0708-5d4e-a83f-c5de661cf19d with scrape type 2
2026-03-29 06:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adfe1580-0708-5d4e-a83f-c5de661cf19d with scrape type 2
2026-03-29 06:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: adfe1580-0708-5d4e-a83f-c5de661cf19d, identifier: CS08088
2026-03-29 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-29 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-29 06:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088 to the API
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': 'adfe1580-0708-5d4e-a83f-c5de661cf19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS08088',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 73097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-29 06:30:56 [auto1.be] INFO: Saving data for CS08088: {'auction_closing_time': 1774883102.0, 'created_time': 1774557073.305658, 'last_price_update_time': 1774765856.93959}
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS08088') HTTP/1.1" 204 0
2026-03-29 06:30:56 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-29 06:30:56 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-29 06:30:56 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-29 06:30:56 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-29 06:30:56 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-29 06:30:57 [auto1.be] INFO: Scrape type for VH38978: 2
2026-03-29 06:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-29 06:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bce93e7-3742-5e77-aea9-ff747806c471 with scrape type 2
2026-03-29 06:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bce93e7-3742-5e77-aea9-ff747806c471 with scrape type 2
2026-03-29 06:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bce93e7-3742-5e77-aea9-ff747806c471, identifier: VH38978
2026-03-29 06:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-29 06:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-29 06:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978 to the API
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:31Z',
 'fuel_type': 'diesel',
 'id': '1bce93e7-3742-5e77-aea9-ff747806c471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH38978',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 123493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2014}
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-29 06:30:57 [auto1.be] INFO: Saving data for VH38978: {'auction_closing_time': 1774883611.0, 'created_time': 1774557070.813886, 'last_price_update_time': 1774765857.405225}
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VH38978') HTTP/1.1" 204 0
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 06:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:30:57 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1093 | hits on page: 40
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-29 06:30:57 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-29 06:30:57 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-29 06:30:57 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-29 06:30:57 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-29 06:30:57 [auto1.be] INFO: Scrape type for TT75307: 2
2026-03-29 06:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-29 06:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be96da6-1122-530d-ac76-d4cae71b5afe with scrape type 2
2026-03-29 06:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be96da6-1122-530d-ac76-d4cae71b5afe with scrape type 2
2026-03-29 06:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7be96da6-1122-530d-ac76-d4cae71b5afe, identifier: TT75307
2026-03-29 06:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 06:30:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-29 06:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307 to the API
2026-03-29 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:17Z',
 'fuel_type': 'diesel',
 'id': '7be96da6-1122-530d-ac76-d4cae71b5afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT75307',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 65422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-05',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-29 06:30:58 [auto1.be] INFO: Saving data for TT75307: {'auction_closing_time': 1774883897.0, 'created_time': 1774557235.793881, 'last_price_update_time': 1774765858.14528}
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT75307') HTTP/1.1" 204 0
2026-03-29 06:30:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:30:58 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-29 06:30:58 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-29 06:30:58 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 06:30:58 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-29 06:30:58 [auto1.be] INFO: Scrape type for DH21315: 2
2026-03-29 06:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-29 06:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eeef821-e9b6-5408-9795-db3f0b0a6098 with scrape type 2
2026-03-29 06:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eeef821-e9b6-5408-9795-db3f0b0a6098 with scrape type 2
2026-03-29 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2eeef821-e9b6-5408-9795-db3f0b0a6098, identifier: DH21315
2026-03-29 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-29 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-29 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315 to the API
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:18Z',
 'fuel_type': 'hybrid',
 'id': '2eeef821-e9b6-5408-9795-db3f0b0a6098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH21315',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 70634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Longitude',
 'transmission': 'automatic',
 'trim': 'Longitude',
 'year': 2022}
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-29 06:30:58 [auto1.be] INFO: Saving data for DH21315: {'auction_closing_time': 1774885698.0, 'created_time': 1774557104.067219, 'last_price_update_time': 1774765858.675762}
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH21315') HTTP/1.1" 204 0
2026-03-29 06:30:58 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-29 06:30:58 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-29 06:30:58 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 06:30:58 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-29 06:30:58 [auto1.be] INFO: Scrape type for RG44645: 2
2026-03-29 06:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-29 06:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a01386-52ec-53c5-9081-20e192543e2a with scrape type 2
2026-03-29 06:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a01386-52ec-53c5-9081-20e192543e2a with scrape type 2
2026-03-29 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7a01386-52ec-53c5-9081-20e192543e2a, identifier: RG44645
2026-03-29 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-29 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-29 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645 to the API
2026-03-29 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'b7a01386-52ec-53c5-9081-20e192543e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG44645',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 231514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2015}
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Saving data for RG44645: {'auction_closing_time': 1774884609.0, 'created_time': 1774643611.764016, 'last_price_update_time': 1774765859.135396}
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RG44645') HTTP/1.1" 204 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for FT96499: 2
2026-03-29 06:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-29 06:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecd41b0-500f-5767-8029-5f9550729423 with scrape type 2
2026-03-29 06:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecd41b0-500f-5767-8029-5f9550729423 with scrape type 2
2026-03-29 06:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ecd41b0-500f-5767-8029-5f9550729423, identifier: FT96499
2026-03-29 06:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-29 06:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-29 06:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499 to the API
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:37Z',
 'fuel_type': 'petrol',
 'id': '2ecd41b0-500f-5767-8029-5f9550729423',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT96499',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 25850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2020}
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Saving data for FT96499: {'auction_closing_time': 1774886317.0, 'created_time': 1774557069.442864, 'last_price_update_time': 1774765859.617162}
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT96499') HTTP/1.1" 204 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-29 06:30:59 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-29 06:30:59 [auto1.be] INFO: Scrape type for AX12673: 2
2026-03-29 06:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-29 06:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 with scrape type 2
2026-03-29 06:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 with scrape type 2
2026-03-29 06:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fba3529-108b-5d2a-b9e6-62c793f85b36, identifier: AX12673
2026-03-29 06:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-29 06:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-29 06:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673 to the API
2026-03-29 06:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:13Z',
 'fuel_type': 'diesel',
 'id': '6fba3529-108b-5d2a-b9e6-62c793f85b36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX12673',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 187259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Saving data for AX12673: {'auction_closing_time': 1774884313.0, 'created_time': 1774643685.270479, 'last_price_update_time': 1774765860.189986}
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX12673') HTTP/1.1" 204 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for HH24769: 2
2026-03-29 06:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-29 06:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with scrape type 2
2026-03-29 06:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with scrape type 2
2026-03-29 06:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63bf927a-c95c-5e4d-a667-a96f479ae7b8, identifier: HH24769
2026-03-29 06:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-29 06:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-29 06:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769 to the API
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:25Z',
 'fuel_type': 'diesel',
 'id': '63bf927a-c95c-5e4d-a667-a96f479ae7b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH24769',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 138785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Saving data for HH24769: {'auction_closing_time': 1774883785.0, 'created_time': 1774643627.944707, 'last_price_update_time': 1774765860.65705}
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH24769') HTTP/1.1" 204 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-29 06:31:00 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-29 06:31:00 [auto1.be] INFO: Scrape type for RM51088: 2
2026-03-29 06:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-29 06:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c4b978-7553-5b88-b410-5d869264a521 with scrape type 2
2026-03-29 06:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c4b978-7553-5b88-b410-5d869264a521 with scrape type 2
2026-03-29 06:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78c4b978-7553-5b88-b410-5d869264a521, identifier: RM51088
2026-03-29 06:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-29 06:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-29 06:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088 to the API
2026-03-29 06:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'diesel',
 'id': '78c4b978-7553-5b88-b410-5d869264a521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM51088',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 74889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 e-HDi Red Edition',
 'transmission': 'manual',
 'trim': 'Red Edition',
 'year': 2015}
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-29 06:31:01 [auto1.be] INFO: Saving data for RM51088: {'auction_closing_time': 1774883702.0, 'created_time': 1774643669.746717, 'last_price_update_time': 1774765861.118178}
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM51088') HTTP/1.1" 204 0
2026-03-29 06:31:01 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-29 06:31:01 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-29 06:31:01 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 06:31:01 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-29 06:31:01 [auto1.be] INFO: Scrape type for JC96921: 2
2026-03-29 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-29 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2051630-c42a-5d6f-be76-1902a8b67a62 with scrape type 2
2026-03-29 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2051630-c42a-5d6f-be76-1902a8b67a62 with scrape type 2
2026-03-29 06:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2051630-c42a-5d6f-be76-1902a8b67a62, identifier: JC96921
2026-03-29 06:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-29 06:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-29 06:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921 to the API
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'diesel',
 'id': 'd2051630-c42a-5d6f-be76-1902a8b67a62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC96921',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 95234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-06',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-29 06:31:01 [auto1.be] INFO: Saving data for JC96921: {'auction_closing_time': 1774884351.0, 'created_time': 1774643607.231004, 'last_price_update_time': 1774765861.636229}
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC96921') HTTP/1.1" 204 0
2026-03-29 06:31:01 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-29 06:31:01 [auto1.be] INFO: Scrape type for CS46874: 2
2026-03-29 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-29 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a005ab-8638-5fcf-a703-140bcf3ce8af with scrape type 2
2026-03-29 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a005ab-8638-5fcf-a703-140bcf3ce8af with scrape type 2
2026-03-29 06:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8a005ab-8638-5fcf-a703-140bcf3ce8af, identifier: CS46874
2026-03-29 06:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-29 06:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-29 06:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874 to the API
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:04Z',
 'fuel_type': 'petrol',
 'id': 'd8a005ab-8638-5fcf-a703-140bcf3ce8af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS46874',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 160033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2011}
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-29 06:31:02 [auto1.be] INFO: Saving data for CS46874: {'auction_closing_time': 1774885444.0, 'created_time': 1774557093.995115, 'last_price_update_time': 1774765862.101694}
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS46874') HTTP/1.1" 204 0
2026-03-29 06:31:02 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 06:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:02 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:02 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 06:31:02 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 06:31:02 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-29 06:31:02 [auto1.be] INFO: Scrape type for HG61894: 2
2026-03-29 06:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-29 06:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with scrape type 2
2026-03-29 06:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with scrape type 2
2026-03-29 06:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1, identifier: HG61894
2026-03-29 06:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-29 06:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-29 06:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894 to the API
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:19Z',
 'fuel_type': 'diesel',
 'id': '92ed346f-bea4-53ac-8a8e-ac9f15ca07c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG61894',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 128355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-29 06:31:02 [auto1.be] INFO: Saving data for HG61894: {'auction_closing_time': 1774885699.0, 'created_time': 1774643651.486528, 'last_price_update_time': 1774765862.615287}
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HG61894') HTTP/1.1" 204 0
2026-03-29 06:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:02 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-29 06:31:02 [auto1.be] INFO: Scrape type for RB98158: 2
2026-03-29 06:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-29 06:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with scrape type 2
2026-03-29 06:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with scrape type 2
2026-03-29 06:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b, identifier: RB98158
2026-03-29 06:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-29 06:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-29 06:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158 to the API
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:31Z',
 'fuel_type': 'diesel',
 'id': '1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB98158',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 213660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-08',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2014}
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Saving data for RB98158: {'auction_closing_time': 1774884391.0, 'created_time': 1774643670.43135, 'last_price_update_time': 1774765863.042997}
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB98158') HTTP/1.1" 204 0
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Scrape type for WA78577: 2
2026-03-29 06:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-29 06:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with scrape type 2
2026-03-29 06:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with scrape type 2
2026-03-29 06:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6, identifier: WA78577
2026-03-29 06:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-29 06:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-29 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577 to the API
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:14:39Z',
 'fuel_type': 'diesel',
 'id': 'a603700c-8eed-5a9f-9b5e-2a3a80c36eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA78577',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 126790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Saving data for WA78577: {'auction_closing_time': 1774883679.0, 'created_time': 1774557074.542997, 'last_price_update_time': 1774765863.478085}
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA78577') HTTP/1.1" 204 0
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-29 06:31:03 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-29 06:31:03 [auto1.be] INFO: Scrape type for WU67286: 2
2026-03-29 06:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-29 06:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c5d6d2f-0524-5caf-8730-1b67876e390b with scrape type 2
2026-03-29 06:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c5d6d2f-0524-5caf-8730-1b67876e390b with scrape type 2
2026-03-29 06:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c5d6d2f-0524-5caf-8730-1b67876e390b, identifier: WU67286
2026-03-29 06:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-29 06:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-29 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286 to the API
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:33:21Z',
 'fuel_type': 'diesel',
 'id': '2c5d6d2f-0524-5caf-8730-1b67876e390b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU67286',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 256770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kasten L2H1 2,9t Doppelkabine',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t Doppelkabine',
 'year': 2013}
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Saving data for WU67286: {'auction_closing_time': 1774884801.0, 'created_time': 1774557071.226326, 'last_price_update_time': 1774765864.051027}
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU67286') HTTP/1.1" 204 0
2026-03-29 06:31:04 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-29 06:31:04 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 06:31:04 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-29 06:31:04 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-29 06:31:04 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Scrape type for FS62191: 2
2026-03-29 06:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-29 06:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c773424-bccf-594a-b9f2-3927cc0e113c with scrape type 2
2026-03-29 06:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c773424-bccf-594a-b9f2-3927cc0e113c with scrape type 2
2026-03-29 06:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c773424-bccf-594a-b9f2-3927cc0e113c, identifier: FS62191
2026-03-29 06:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-29 06:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-29 06:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191 to the API
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:04Z',
 'fuel_type': 'petrol',
 'id': '5c773424-bccf-594a-b9f2-3927cc0e113c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS62191',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 93400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20i Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Saving data for FS62191: {'auction_closing_time': 1774883284.0, 'created_time': 1773866601.069438, 'last_price_update_time': 1774765864.651217}
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS62191') HTTP/1.1" 204 0
2026-03-29 06:31:04 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-29 06:31:04 [auto1.be] INFO: Scrape type for WU43595: 2
2026-03-29 06:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-29 06:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca14168e-cc49-55ea-8119-9684b8ea4f0a with scrape type 2
2026-03-29 06:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca14168e-cc49-55ea-8119-9684b8ea4f0a with scrape type 2
2026-03-29 06:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca14168e-cc49-55ea-8119-9684b8ea4f0a, identifier: WU43595
2026-03-29 06:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-29 06:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-29 06:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595 to the API
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:49:35Z',
 'fuel_type': 'diesel',
 'id': 'ca14168e-cc49-55ea-8119-9684b8ea4f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU43595',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 35619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Saving data for WU43595: {'auction_closing_time': 1774885775.0, 'created_time': 1773520257.455045, 'last_price_update_time': 1774765865.082983}
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU43595') HTTP/1.1" 204 0
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Scrape type for XL26167: 0
2026-03-29 06:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:05 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:05 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-29 06:31:05 [auto1.be] INFO: Scrape type for YJ00240: 2
2026-03-29 06:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-29 06:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c148a875-8b3a-5c20-b7bf-4f7bda84682a with scrape type 2
2026-03-29 06:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c148a875-8b3a-5c20-b7bf-4f7bda84682a with scrape type 2
2026-03-29 06:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c148a875-8b3a-5c20-b7bf-4f7bda84682a, identifier: YJ00240
2026-03-29 06:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-29 06:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-29 06:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240 to the API
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'c148a875-8b3a-5c20-b7bf-4f7bda84682a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ00240',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 259930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-22',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2015}
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-29 06:31:06 [auto1.be] INFO: Saving data for YJ00240: {'auction_closing_time': 1774884609.0, 'created_time': 1774643675.202451, 'last_price_update_time': 1774765866.062809}
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ00240') HTTP/1.1" 204 0
2026-03-29 06:31:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:06 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 06:31:06 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-29 06:31:06 [auto1.be] INFO: Scrape type for GF65026: 2
2026-03-29 06:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-29 06:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b69ed5-a932-5905-a3d4-cdf0da70402e with scrape type 2
2026-03-29 06:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40b69ed5-a932-5905-a3d4-cdf0da70402e with scrape type 2
2026-03-29 06:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40b69ed5-a932-5905-a3d4-cdf0da70402e, identifier: GF65026
2026-03-29 06:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-29 06:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-29 06:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026 to the API
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'petrol',
 'id': '40b69ed5-a932-5905-a3d4-cdf0da70402e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF65026',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 126051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-29 06:31:06 [auto1.be] INFO: Saving data for GF65026: {'auction_closing_time': 1774885985.0, 'created_time': 1773779689.446213, 'last_price_update_time': 1774765866.598693}
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF65026') HTTP/1.1" 204 0
2026-03-29 06:31:06 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-29 06:31:06 [auto1.be] INFO: Scrape type for HS49836: 2
2026-03-29 06:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-29 06:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37a60ee-f930-574d-82be-1a702a31b7e5 with scrape type 2
2026-03-29 06:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f37a60ee-f930-574d-82be-1a702a31b7e5 with scrape type 2
2026-03-29 06:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f37a60ee-f930-574d-82be-1a702a31b7e5, identifier: HS49836
2026-03-29 06:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-29 06:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-29 06:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836 to the API
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'petrol',
 'id': 'f37a60ee-f930-574d-82be-1a702a31b7e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS49836',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 92340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Saving data for HS49836: {'auction_closing_time': 1774883944.0, 'created_time': 1774643646.037091, 'last_price_update_time': 1774765867.035389}
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS49836') HTTP/1.1" 204 0
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Scrape type for CS20047: 2
2026-03-29 06:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-29 06:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9315727-438e-577e-93ee-c9466ccaf151 with scrape type 2
2026-03-29 06:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9315727-438e-577e-93ee-c9466ccaf151 with scrape type 2
2026-03-29 06:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9315727-438e-577e-93ee-c9466ccaf151, identifier: CS20047
2026-03-29 06:31:07 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 14 pages/min), scraped 63 items (at 63 items/min)
2026-03-29 06:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 06:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-29 06:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-29 06:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047 to the API
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:39:07Z',
 'fuel_type': 'diesel',
 'id': 'b9315727-438e-577e-93ee-c9466ccaf151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS20047',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 196118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-15',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Saving data for CS20047: {'auction_closing_time': 1774885147.0, 'created_time': 1774643651.067447, 'last_price_update_time': 1774765867.517293}
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS20047') HTTP/1.1" 204 0
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 06:31:07 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Scrape type for RL24593: 2
2026-03-29 06:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-29 06:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9ef8c0e-2cfa-5d16-b352-8a129b53477b with scrape type 2
2026-03-29 06:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9ef8c0e-2cfa-5d16-b352-8a129b53477b with scrape type 2
2026-03-29 06:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9ef8c0e-2cfa-5d16-b352-8a129b53477b, identifier: RL24593
2026-03-29 06:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-29 06:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-29 06:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593 to the API
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:44:53Z',
 'fuel_type': 'petrol',
 'id': 'd9ef8c0e-2cfa-5d16-b352-8a129b53477b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL24593',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 95375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Citroen C2 1.1 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-29 06:31:07 [auto1.be] INFO: Saving data for RL24593: {'auction_closing_time': 1774885493.0, 'created_time': 1774557186.204094, 'last_price_update_time': 1774765867.980696}
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL24593') HTTP/1.1" 204 0
2026-03-29 06:31:08 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 06:31:08 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-29 06:31:08 [auto1.be] INFO: Scrape type for XV14848: 2
2026-03-29 06:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-29 06:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73768219-642a-599a-b543-150284d0217e with scrape type 2
2026-03-29 06:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73768219-642a-599a-b543-150284d0217e with scrape type 2
2026-03-29 06:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73768219-642a-599a-b543-150284d0217e, identifier: XV14848
2026-03-29 06:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-29 06:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-29 06:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848 to the API
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:30:02Z',
 'fuel_type': 'petrol',
 'id': '73768219-642a-599a-b543-150284d0217e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV14848',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 122829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-29 06:31:08 [auto1.be] INFO: Saving data for XV14848: {'auction_closing_time': 1774884602.0, 'created_time': 1774557091.708332, 'last_price_update_time': 1774765868.498029}
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XV14848') HTTP/1.1" 204 0
2026-03-29 06:31:08 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-29 06:31:08 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-29 06:31:08 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-29 06:31:08 [auto1.be] INFO: Scrape type for CH15764: 2
2026-03-29 06:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-29 06:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with scrape type 2
2026-03-29 06:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with scrape type 2
2026-03-29 06:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3, identifier: CH15764
2026-03-29 06:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-29 06:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-29 06:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764 to the API
2026-03-29 06:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:12:50Z',
 'fuel_type': 'petrol',
 'id': '2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH15764',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 115167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-29 06:31:10 [auto1.be] INFO: Saving data for CH15764: {'auction_closing_time': 1774883570.0, 'created_time': 1773693293.869452, 'last_price_update_time': 1774765870.336573}
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH15764') HTTP/1.1" 204 0
2026-03-29 06:31:10 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 06:31:10 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-29 06:31:10 [auto1.be] INFO: Scrape type for AX58227: 2
2026-03-29 06:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-29 06:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a19676-1b6e-5222-a431-c70f0c69f0da with scrape type 2
2026-03-29 06:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a19676-1b6e-5222-a431-c70f0c69f0da with scrape type 2
2026-03-29 06:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78a19676-1b6e-5222-a431-c70f0c69f0da, identifier: AX58227
2026-03-29 06:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-29 06:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-29 06:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227 to the API
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': '78a19676-1b6e-5222-a431-c70f0c69f0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX58227',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 177531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-29 06:31:10 [auto1.be] INFO: Saving data for AX58227: {'auction_closing_time': 1774884617.0, 'created_time': 1774557178.874044, 'last_price_update_time': 1774765870.766665}
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX58227') HTTP/1.1" 204 0
2026-03-29 06:31:10 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-29 06:31:10 [auto1.be] INFO: Scrape type for GG92230: 2
2026-03-29 06:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-29 06:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d05296d-0859-511e-9c11-3277a7c46677 with scrape type 2
2026-03-29 06:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d05296d-0859-511e-9c11-3277a7c46677 with scrape type 2
2026-03-29 06:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d05296d-0859-511e-9c11-3277a7c46677, identifier: GG92230
2026-03-29 06:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-29 06:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-29 06:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230 to the API
2026-03-29 06:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:08Z',
 'fuel_type': 'diesel',
 'id': '7d05296d-0859-511e-9c11-3277a7c46677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG92230',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 98622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-29 06:31:11 [auto1.be] INFO: Saving data for GG92230: {'auction_closing_time': 1774884008.0, 'created_time': 1773953006.288354, 'last_price_update_time': 1774765871.204969}
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG92230') HTTP/1.1" 204 0
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-29 06:31:11 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-29 06:31:11 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-29 06:31:11 [auto1.be] INFO: Scrape type for XH41981: 2
2026-03-29 06:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-29 06:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with scrape type 2
2026-03-29 06:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with scrape type 2
2026-03-29 06:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa, identifier: XH41981
2026-03-29 06:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-29 06:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-29 06:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981 to the API
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'diesel',
 'id': '7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 91890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI RWD L2',
 'transmission': 'manual',
 'trim': 'RWD L2',
 'year': 2019}
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-29 06:31:11 [auto1.be] INFO: Saving data for XH41981: {'auction_closing_time': 1774884339.0, 'created_time': 1774557203.357526, 'last_price_update_time': 1774765871.678014}
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH41981') HTTP/1.1" 204 0
2026-03-29 06:31:11 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-29 06:31:11 [auto1.be] INFO: Scrape type for SV23823: 2
2026-03-29 06:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-29 06:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11bb0ce2-f631-5cbe-8d25-185616472de3 with scrape type 2
2026-03-29 06:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11bb0ce2-f631-5cbe-8d25-185616472de3 with scrape type 2
2026-03-29 06:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11bb0ce2-f631-5cbe-8d25-185616472de3, identifier: SV23823
2026-03-29 06:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-29 06:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-29 06:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823 to the API
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'diesel',
 'id': '11bb0ce2-f631-5cbe-8d25-185616472de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV23823',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 72737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2017}
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Saving data for SV23823: {'auction_closing_time': 1774883322.0, 'created_time': 1774643659.931199, 'last_price_update_time': 1774765872.224178}
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV23823') HTTP/1.1" 204 0
2026-03-29 06:31:12 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Scrape type for SX30605: 0
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Scrape type for TH79553: 2
2026-03-29 06:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-29 06:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631e56e-713b-5129-a480-c2f713cdb8f5 with scrape type 2
2026-03-29 06:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1631e56e-713b-5129-a480-c2f713cdb8f5 with scrape type 2
2026-03-29 06:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1631e56e-713b-5129-a480-c2f713cdb8f5, identifier: TH79553
2026-03-29 06:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-29 06:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-29 06:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553 to the API
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:50:43Z',
 'fuel_type': 'petrol',
 'id': '1631e56e-713b-5129-a480-c2f713cdb8f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH79553',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 93406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-28',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Saving data for TH79553: {'auction_closing_time': 1774885843.0, 'created_time': 1774557107.436338, 'last_price_update_time': 1774765872.766521}
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH79553') HTTP/1.1" 204 0
2026-03-29 06:31:12 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-29 06:31:12 [auto1.be] INFO: Scrape type for ZJ26609: 2
2026-03-29 06:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-29 06:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af47f6a-5867-55f6-be17-46f1d0252695 with scrape type 2
2026-03-29 06:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af47f6a-5867-55f6-be17-46f1d0252695 with scrape type 2
2026-03-29 06:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4af47f6a-5867-55f6-be17-46f1d0252695, identifier: ZJ26609
2026-03-29 06:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 06:31:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-29 06:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609 to the API
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:57:50Z',
 'fuel_type': 'petrol',
 'id': '4af47f6a-5867-55f6-be17-46f1d0252695',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ26609',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 96165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-29 06:31:13 [auto1.be] INFO: Saving data for ZJ26609: {'auction_closing_time': 1774886270.0, 'created_time': 1774557187.648745, 'last_price_update_time': 1774765873.431581}
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ26609') HTTP/1.1" 204 0
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-29 06:31:13 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-29 06:31:13 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-29 06:31:13 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-29 06:31:13 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-29 06:31:13 [auto1.be] INFO: Scrape type for TV22564: 2
2026-03-29 06:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-29 06:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b075b720-14d8-560d-9ac6-feeca91fea2b with scrape type 2
2026-03-29 06:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b075b720-14d8-560d-9ac6-feeca91fea2b with scrape type 2
2026-03-29 06:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b075b720-14d8-560d-9ac6-feeca91fea2b, identifier: TV22564
2026-03-29 06:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-29 06:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-29 06:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564 to the API
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:09:40Z',
 'fuel_type': 'diesel',
 'id': 'b075b720-14d8-560d-9ac6-feeca91fea2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV22564',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 189507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-24',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-29 06:31:13 [auto1.be] INFO: Saving data for TV22564: {'auction_closing_time': 1774883380.0, 'created_time': 1773237825.833481, 'last_price_update_time': 1774765873.92485}
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV22564') HTTP/1.1" 204 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for MJ77172: 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for RK68346: 2
2026-03-29 06:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-29 06:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b6344d-cf9f-576b-876a-86d555ceef5c with scrape type 2
2026-03-29 06:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5b6344d-cf9f-576b-876a-86d555ceef5c with scrape type 2
2026-03-29 06:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5b6344d-cf9f-576b-876a-86d555ceef5c, identifier: RK68346
2026-03-29 06:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-29 06:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-29 06:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346 to the API
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:34Z',
 'fuel_type': 'diesel',
 'id': 'c5b6344d-cf9f-576b-876a-86d555ceef5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK68346',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 330990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Saving data for RK68346: {'auction_closing_time': 1774884874.0, 'created_time': 1774643653.653374, 'last_price_update_time': 1774765874.555358}
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK68346') HTTP/1.1" 204 0
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 06:31:14 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-29 06:31:14 [auto1.be] INFO: Scrape type for JX04101: 2
2026-03-29 06:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-29 06:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d92782b-9b84-5c05-ae4a-9825cdb5422e with scrape type 2
2026-03-29 06:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d92782b-9b84-5c05-ae4a-9825cdb5422e with scrape type 2
2026-03-29 06:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d92782b-9b84-5c05-ae4a-9825cdb5422e, identifier: JX04101
2026-03-29 06:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-29 06:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-29 06:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101 to the API
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:08:41Z',
 'fuel_type': 'diesel',
 'id': '0d92782b-9b84-5c05-ae4a-9825cdb5422e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX04101',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 214547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Select 2WD',
 'transmission': 'manual',
 'trim': 'Select 2WD',
 'year': 2020}
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Saving data for JX04101: {'auction_closing_time': 1774883321.0, 'created_time': 1774557105.977778, 'last_price_update_time': 1774765875.088925}
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX04101') HTTP/1.1" 204 0
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Scrape type for SD15124: 2
2026-03-29 06:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-29 06:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cebe66-925b-51d8-aa9d-271032bb0878 with scrape type 2
2026-03-29 06:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cebe66-925b-51d8-aa9d-271032bb0878 with scrape type 2
2026-03-29 06:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 47cebe66-925b-51d8-aa9d-271032bb0878, identifier: SD15124
2026-03-29 06:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-29 06:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-29 06:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124 to the API
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:26Z',
 'fuel_type': 'diesel',
 'id': '47cebe66-925b-51d8-aa9d-271032bb0878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD15124',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 225805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-24',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'manual',
 'trim': 'xLine',
 'year': 2016}
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Saving data for SD15124: {'auction_closing_time': 1774885166.0, 'created_time': 1774643682.572923, 'last_price_update_time': 1774765875.498567}
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD15124') HTTP/1.1" 204 0
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-29 06:31:15 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-29 06:31:15 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 06:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:16 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:16 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-29 06:31:16 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-29 06:31:16 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-29 06:31:16 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-29 06:31:16 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 06:31:16 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-29 06:31:16 [auto1.be] INFO: Scrape type for AF71611: 2
2026-03-29 06:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-29 06:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aebb3b2-a202-50dc-b817-b9d631831bd9 with scrape type 2
2026-03-29 06:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aebb3b2-a202-50dc-b817-b9d631831bd9 with scrape type 2
2026-03-29 06:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9aebb3b2-a202-50dc-b817-b9d631831bd9, identifier: AF71611
2026-03-29 06:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-29 06:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-29 06:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611 to the API
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:36:26Z',
 'fuel_type': 'hybrid',
 'id': '9aebb3b2-a202-50dc-b817-b9d631831bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF71611',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 172156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seller_name': None,
 'title': 'BMW 7er 745e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Saving data for AF71611: {'auction_closing_time': 1774884986.0, 'created_time': 1773952873.549187, 'last_price_update_time': 1774765877.59965}
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF71611') HTTP/1.1" 204 0
2026-03-29 06:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 06:31:17 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-29 06:31:17 [auto1.be] INFO: Scrape type for HT09098: 2
2026-03-29 06:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-29 06:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 with scrape type 2
2026-03-29 06:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 with scrape type 2
2026-03-29 06:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5ceac93-e1c0-5054-97d1-2e87f4891b39, identifier: HT09098
2026-03-29 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-29 06:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-29 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098 to the API
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'diesel',
 'id': 'c5ceac93-e1c0-5054-97d1-2e87f4891b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT09098',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 150197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-29 06:31:18 [auto1.be] INFO: Saving data for HT09098: {'auction_closing_time': 1774884291.0, 'created_time': 1774643685.635811, 'last_price_update_time': 1774765878.256071}
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT09098') HTTP/1.1" 204 0
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-29 06:31:18 [auto1.be] INFO: Scrape type for KC19835: 2
2026-03-29 06:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-29 06:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with scrape type 2
2026-03-29 06:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with scrape type 2
2026-03-29 06:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c27705c-c5f8-5a7b-baef-f8308811f3e0, identifier: KC19835
2026-03-29 06:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-29 06:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-29 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835 to the API
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:35Z',
 'fuel_type': 'diesel',
 'id': '4c27705c-c5f8-5a7b-baef-f8308811f3e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC19835',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 83454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Start&Stop',
 'transmission': 'manual',
 'trim': 'Start&Stop',
 'year': 2020}
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-29 06:31:18 [auto1.be] INFO: Saving data for KC19835: {'auction_closing_time': 1774884875.0, 'created_time': 1774643667.164306, 'last_price_update_time': 1774765878.768439}
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC19835') HTTP/1.1" 204 0
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-29 06:31:18 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-29 06:31:18 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-29 06:31:18 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-29 06:31:18 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 06:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:20 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:20 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-29 06:31:20 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-29 06:31:20 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 06:31:20 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-29 06:31:20 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-29 06:31:20 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 06:31:20 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-29 06:31:20 [auto1.be] INFO: Scrape type for BC69430: 2
2026-03-29 06:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-29 06:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4441441f-4e8f-5b4c-9ffe-357852997dc4 with scrape type 2
2026-03-29 06:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4441441f-4e8f-5b4c-9ffe-357852997dc4 with scrape type 2
2026-03-29 06:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4441441f-4e8f-5b4c-9ffe-357852997dc4, identifier: BC69430
2026-03-29 06:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-29 06:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-29 06:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430 to the API
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:01Z',
 'fuel_type': 'diesel',
 'id': '4441441f-4e8f-5b4c-9ffe-357852997dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC69430',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-01',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-29 06:31:20 [auto1.be] INFO: Saving data for BC69430: {'auction_closing_time': 1774885801.0, 'created_time': 1773909036.439363, 'last_price_update_time': 1774765880.983563}
2026-03-29 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC69430') HTTP/1.1" 204 0
2026-03-29 06:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Scrape type for CR22525: 2
2026-03-29 06:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-29 06:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9191288-0176-59a8-911f-1ca9935b23e1 with scrape type 2
2026-03-29 06:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9191288-0176-59a8-911f-1ca9935b23e1 with scrape type 2
2026-03-29 06:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9191288-0176-59a8-911f-1ca9935b23e1, identifier: CR22525
2026-03-29 06:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-29 06:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-29 06:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525 to the API
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:09:53Z',
 'fuel_type': 'petrol',
 'id': 'f9191288-0176-59a8-911f-1ca9935b23e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR22525',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 46268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-27',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2024}
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Saving data for CR22525: {'auction_closing_time': 1774883393.0, 'created_time': 1774643671.449393, 'last_price_update_time': 1774765881.481263}
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CR22525') HTTP/1.1" 204 0
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-29 06:31:21 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Scrape type for WA39171: 2
2026-03-29 06:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-29 06:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181b9bb8-28ad-519c-a860-e98eb7da57e5 with scrape type 2
2026-03-29 06:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 181b9bb8-28ad-519c-a860-e98eb7da57e5 with scrape type 2
2026-03-29 06:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 181b9bb8-28ad-519c-a860-e98eb7da57e5, identifier: WA39171
2026-03-29 06:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-29 06:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-29 06:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171 to the API
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:04Z',
 'fuel_type': 'diesel',
 'id': '181b9bb8-28ad-519c-a860-e98eb7da57e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA39171',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 142845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seller_name': None,
 'title': 'BMW 6er 620d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-29 06:31:21 [auto1.be] INFO: Saving data for WA39171: {'auction_closing_time': 1774882804.0, 'created_time': 1774557128.743925, 'last_price_update_time': 1774765881.969402}
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA39171') HTTP/1.1" 204 0
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-29 06:31:22 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-29 06:31:22 [auto1.be] INFO: Scrape type for ZH14429: 2
2026-03-29 06:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-29 06:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7588cc-1942-54d2-b932-522eaa422537 with scrape type 2
2026-03-29 06:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7588cc-1942-54d2-b932-522eaa422537 with scrape type 2
2026-03-29 06:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc7588cc-1942-54d2-b932-522eaa422537, identifier: ZH14429
2026-03-29 06:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-29 06:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-29 06:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429 to the API
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'diesel',
 'id': 'fc7588cc-1942-54d2-b932-522eaa422537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 233552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-29 06:31:22 [auto1.be] INFO: Saving data for ZH14429: {'auction_closing_time': 1774883610.0, 'created_time': 1774557037.957116, 'last_price_update_time': 1774765882.491857}
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH14429') HTTP/1.1" 204 0
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-29 06:31:22 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-29 06:31:22 [auto1.be] INFO: Scrape type for VM79296: 2
2026-03-29 06:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-29 06:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16975dda-a13c-54ca-a9f5-8724e17b1f52 with scrape type 2
2026-03-29 06:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16975dda-a13c-54ca-a9f5-8724e17b1f52 with scrape type 2
2026-03-29 06:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16975dda-a13c-54ca-a9f5-8724e17b1f52, identifier: VM79296
2026-03-29 06:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-29 06:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-29 06:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296 to the API
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:43Z',
 'fuel_type': 'diesel',
 'id': '16975dda-a13c-54ca-a9f5-8724e17b1f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM79296',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Bipper',
 'odometer': 113242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Peugeot Bipper 1.3 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-29 06:31:22 [auto1.be] INFO: Saving data for VM79296: {'auction_closing_time': 1774884883.0, 'created_time': 1773434064.981091, 'last_price_update_time': 1774765882.966684}
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM79296') HTTP/1.1" 204 0
2026-03-29 06:31:22 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Scrape type for YF30387: 2
2026-03-29 06:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-29 06:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc with scrape type 2
2026-03-29 06:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc with scrape type 2
2026-03-29 06:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aff36c0b-bcf9-52e0-9032-6e7f118b17cc, identifier: YF30387
2026-03-29 06:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-29 06:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-29 06:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387 to the API
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'diesel',
 'id': 'aff36c0b-bcf9-52e0-9032-6e7f118b17cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF30387',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 178201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Saving data for YF30387: {'auction_closing_time': 1774884614.0, 'created_time': 1774643624.717016, 'last_price_update_time': 1774765883.382369}
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF30387') HTTP/1.1" 204 0
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 06:31:23 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-29 06:31:23 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-29 06:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:31 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-29 06:31:31 [auto1.be] INFO: Scrape type for YH98972: 2
2026-03-29 06:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-29 06:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6503a6bc-b391-5434-bbc5-2f2f987f650c with scrape type 2
2026-03-29 06:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6503a6bc-b391-5434-bbc5-2f2f987f650c with scrape type 2
2026-03-29 06:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6503a6bc-b391-5434-bbc5-2f2f987f650c, identifier: YH98972
2026-03-29 06:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-29 06:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-29 06:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972 to the API
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:22:53Z',
 'fuel_type': 'diesel',
 'id': '6503a6bc-b391-5434-bbc5-2f2f987f650c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH98972',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 198190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-15',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-29 06:31:31 [auto1.be] INFO: Saving data for YH98972: {'auction_closing_time': 1774884173.0, 'created_time': 1774557192.483845, 'last_price_update_time': 1774765891.833345}
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH98972') HTTP/1.1" 204 0
2026-03-29 06:31:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-29 06:31:31 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-29 06:31:31 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-29 06:31:31 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-29 06:31:31 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-29 06:31:32 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-29 06:31:32 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-29 06:31:32 [auto1.be] INFO: Scrape type for KF59500: 2
2026-03-29 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-29 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bea136e-72af-57e5-86b2-27a644aa7f11 with scrape type 2
2026-03-29 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bea136e-72af-57e5-86b2-27a644aa7f11 with scrape type 2
2026-03-29 06:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bea136e-72af-57e5-86b2-27a644aa7f11, identifier: KF59500
2026-03-29 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-29 06:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-29 06:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500 to the API
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:35:01Z',
 'fuel_type': 'petrol',
 'id': '2bea136e-72af-57e5-86b2-27a644aa7f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF59500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 53112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-10',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Blue Line',
 'transmission': 'manual',
 'trim': 'Blue Line',
 'year': 2004}
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-29 06:31:32 [auto1.be] INFO: Saving data for KF59500: {'auction_closing_time': 1774884901.0, 'created_time': 1773693306.709372, 'last_price_update_time': 1774765892.426576}
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF59500') HTTP/1.1" 204 0
2026-03-29 06:31:32 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-29 06:31:32 [auto1.be] INFO: Scrape type for ZT52703: 2
2026-03-29 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-29 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 with scrape type 2
2026-03-29 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 with scrape type 2
2026-03-29 06:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7feb9c2c-cc83-5421-930e-834c5bfd5694, identifier: ZT52703
2026-03-29 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-29 06:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703 to the API
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:36:52Z',
 'fuel_type': 'diesel',
 'id': '7feb9c2c-cc83-5421-930e-834c5bfd5694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT52703',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 315098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-29 06:31:32 [auto1.be] INFO: Saving data for ZT52703: {'auction_closing_time': 1774885012.0, 'created_time': 1774643666.867865, 'last_price_update_time': 1774765892.95842}
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT52703') HTTP/1.1" 204 0
2026-03-29 06:31:32 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-29 06:31:32 [auto1.be] INFO: Scrape type for ZR52684: 2
2026-03-29 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-29 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with scrape type 2
2026-03-29 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with scrape type 2
2026-03-29 06:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2dc8113-035f-5801-bd6f-331a4cfc9ff8, identifier: ZR52684
2026-03-29 06:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-29 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-29 06:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684 to the API
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:23Z',
 'fuel_type': 'diesel',
 'id': 'd2dc8113-035f-5801-bd6f-331a4cfc9ff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR52684',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 187137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Advantage blue 2WD',
 'transmission': 'manual',
 'trim': 'Advantage blue 2WD',
 'year': 2018}
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Saving data for ZR52684: {'auction_closing_time': 1774883123.0, 'created_time': 1773866092.316563, 'last_price_update_time': 1774765893.37425}
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR52684') HTTP/1.1" 204 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for KW15988: 2
2026-03-29 06:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-29 06:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23368f7c-db3c-5569-ae22-58c4b42cf036 with scrape type 2
2026-03-29 06:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23368f7c-db3c-5569-ae22-58c4b42cf036 with scrape type 2
2026-03-29 06:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23368f7c-db3c-5569-ae22-58c4b42cf036, identifier: KW15988
2026-03-29 06:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-29 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-29 06:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988 to the API
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:37:02Z',
 'fuel_type': 'petrol',
 'id': '23368f7c-db3c-5569-ae22-58c4b42cf036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW15988',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 147402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Saving data for KW15988: {'auction_closing_time': 1774885022.0, 'created_time': 1774643628.565388, 'last_price_update_time': 1774765893.918038}
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW15988') HTTP/1.1" 204 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-29 06:31:33 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 06:31:33 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-29 06:31:34 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-29 06:31:34 [auto1.be] INFO: Scrape type for CM40127: 2
2026-03-29 06:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-29 06:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2b87d4-38b4-5111-be04-c501effca679 with scrape type 2
2026-03-29 06:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad2b87d4-38b4-5111-be04-c501effca679 with scrape type 2
2026-03-29 06:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad2b87d4-38b4-5111-be04-c501effca679, identifier: CM40127
2026-03-29 06:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-29 06:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-29 06:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127 to the API
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:08:43Z',
 'fuel_type': 'hybrid',
 'id': 'ad2b87d4-38b4-5111-be04-c501effca679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM40127',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 196238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-17',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2011}
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-29 06:31:34 [auto1.be] INFO: Saving data for CM40127: {'auction_closing_time': 1774883323.0, 'created_time': 1774557197.630835, 'last_price_update_time': 1774765894.410803}
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM40127') HTTP/1.1" 204 0
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-29 06:31:34 [auto1.be] INFO: Scrape type for UB84592: 2
2026-03-29 06:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-29 06:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516bc0b6-5c82-5f80-9750-93a36a823b57 with scrape type 2
2026-03-29 06:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516bc0b6-5c82-5f80-9750-93a36a823b57 with scrape type 2
2026-03-29 06:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 516bc0b6-5c82-5f80-9750-93a36a823b57, identifier: UB84592
2026-03-29 06:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-29 06:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-29 06:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592 to the API
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:53:53Z',
 'fuel_type': 'diesel',
 'id': '516bc0b6-5c82-5f80-9750-93a36a823b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84592',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 207383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-10',
 'seller_name': None,
 'title': 'Mazda 2 1.4 Diesel CD Elegance',
 'transmission': 'manual',
 'trim': 'CD Elegance',
 'year': 2010}
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-29 06:31:34 [auto1.be] INFO: Saving data for UB84592: {'auction_closing_time': 1774886033.0, 'created_time': 1773923215.556997, 'last_price_update_time': 1774765894.924998}
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB84592') HTTP/1.1" 204 0
2026-03-29 06:31:34 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-29 06:31:35 [auto1.be] INFO: Scrape type for HT96077: 2
2026-03-29 06:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-29 06:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 with scrape type 2
2026-03-29 06:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 with scrape type 2
2026-03-29 06:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3f6612b-fe3c-5c29-8485-9b21469c7c41, identifier: HT96077
2026-03-29 06:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-29 06:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-29 06:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077 to the API
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:04:55Z',
 'fuel_type': 'petrol',
 'id': 'c3f6612b-fe3c-5c29-8485-9b21469c7c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT96077',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 104604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-24',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-29 06:31:35 [auto1.be] INFO: Saving data for HT96077: {'auction_closing_time': 1774883095.0, 'created_time': 1774643662.412123, 'last_price_update_time': 1774765895.449157}
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT96077') HTTP/1.1" 204 0
2026-03-29 06:31:35 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-29 06:31:35 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-29 06:31:35 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 06:31:35 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 06:31:35 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-29 06:31:35 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-29 06:31:35 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-29 06:31:35 [auto1.be] INFO: Scrape type for NM84060: 2
2026-03-29 06:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-29 06:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a630a96-508e-55cb-8691-c0402ec8b828 with scrape type 2
2026-03-29 06:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a630a96-508e-55cb-8691-c0402ec8b828 with scrape type 2
2026-03-29 06:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a630a96-508e-55cb-8691-c0402ec8b828, identifier: NM84060
2026-03-29 06:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-29 06:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-29 06:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060 to the API
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:11Z',
 'fuel_type': 'diesel',
 'id': '2a630a96-508e-55cb-8691-c0402ec8b828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84060',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 216122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2018}
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-29 06:31:35 [auto1.be] INFO: Saving data for NM84060: {'auction_closing_time': 1774883231.0, 'created_time': 1774643568.237832, 'last_price_update_time': 1774765895.905496}
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM84060') HTTP/1.1" 204 0
2026-03-29 06:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:36 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Scrape type for UV50609: 2
2026-03-29 06:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-29 06:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd041ed9-0e63-5459-87c1-cc2e6f82a8da with scrape type 2
2026-03-29 06:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd041ed9-0e63-5459-87c1-cc2e6f82a8da with scrape type 2
2026-03-29 06:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd041ed9-0e63-5459-87c1-cc2e6f82a8da, identifier: UV50609
2026-03-29 06:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-29 06:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-29 06:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609 to the API
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:30Z',
 'fuel_type': 'diesel',
 'id': 'cd041ed9-0e63-5459-87c1-cc2e6f82a8da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV50609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 187875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Saving data for UV50609: {'auction_closing_time': 1774885950.0, 'created_time': 1774557095.193738, 'last_price_update_time': 1774765896.471914}
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV50609') HTTP/1.1" 204 0
2026-03-29 06:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 06:31:36 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-29 06:31:36 [auto1.be] INFO: Scrape type for ZL81412: 2
2026-03-29 06:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-29 06:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with scrape type 2
2026-03-29 06:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with scrape type 2
2026-03-29 06:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc, identifier: ZL81412
2026-03-29 06:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-29 06:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-29 06:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412 to the API
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:47:08Z',
 'fuel_type': 'diesel',
 'id': '5cb16b87-2305-5c8a-a5bf-34edabf5b9cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL81412',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 135478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2003}
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Saving data for ZL81412: {'auction_closing_time': 1774885628.0, 'created_time': 1774643632.708103, 'last_price_update_time': 1774765897.022736}
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL81412') HTTP/1.1" 204 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for KC69840: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for TS87931: 2
2026-03-29 06:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-29 06:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbd44f0-f880-5968-a846-3e3d6ebcd262 with scrape type 2
2026-03-29 06:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbd44f0-f880-5968-a846-3e3d6ebcd262 with scrape type 2
2026-03-29 06:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dbbd44f0-f880-5968-a846-3e3d6ebcd262, identifier: TS87931
2026-03-29 06:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-29 06:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-29 06:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931 to the API
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'hybrid',
 'id': 'dbbd44f0-f880-5968-a846-3e3d6ebcd262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87931',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 172125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Saving data for TS87931: {'auction_closing_time': 1774884152.0, 'created_time': 1774557200.352614, 'last_price_update_time': 1774765897.563464}
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS87931') HTTP/1.1" 204 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for JZ97752: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-29 06:31:37 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-29 06:31:37 [auto1.be] INFO: Scrape type for CG91643: 2
2026-03-29 06:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-29 06:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd084fc6-6df2-5506-a224-00931fb25511 with scrape type 2
2026-03-29 06:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd084fc6-6df2-5506-a224-00931fb25511 with scrape type 2
2026-03-29 06:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd084fc6-6df2-5506-a224-00931fb25511, identifier: CG91643
2026-03-29 06:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-29 06:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-29 06:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643 to the API
2026-03-29 06:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:24:49Z',
 'fuel_type': 'diesel',
 'id': 'bd084fc6-6df2-5506-a224-00931fb25511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG91643',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 190717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2019}
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-29 06:31:38 [auto1.be] INFO: Saving data for CG91643: {'auction_closing_time': 1774884289.0, 'created_time': 1773779683.372451, 'last_price_update_time': 1774765898.15678}
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG91643') HTTP/1.1" 204 0
2026-03-29 06:31:38 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 06:31:38 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 06:31:38 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-29 06:31:38 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-29 06:31:38 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-29 06:31:38 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-29 06:31:38 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 06:31:38 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-29 06:31:38 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-29 06:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:39 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Scrape type for TS87416: 2
2026-03-29 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-29 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e85abd7-0d1a-5972-8153-e65223145e48 with scrape type 2
2026-03-29 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e85abd7-0d1a-5972-8153-e65223145e48 with scrape type 2
2026-03-29 06:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e85abd7-0d1a-5972-8153-e65223145e48, identifier: TS87416
2026-03-29 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-29 06:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-29 06:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416 to the API
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:07:36Z',
 'fuel_type': 'diesel',
 'id': '4e85abd7-0d1a-5972-8153-e65223145e48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87416',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 167898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-24',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2014}
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Saving data for TS87416: {'auction_closing_time': 1774883256.0, 'created_time': 1774557055.560544, 'last_price_update_time': 1774765899.495582}
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS87416') HTTP/1.1" 204 0
2026-03-29 06:31:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:39 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-29 06:31:39 [auto1.be] INFO: Scrape type for YB94076: 2
2026-03-29 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-29 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c30bb17-9073-53c8-a5ed-38c920a8541b with scrape type 2
2026-03-29 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c30bb17-9073-53c8-a5ed-38c920a8541b with scrape type 2
2026-03-29 06:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c30bb17-9073-53c8-a5ed-38c920a8541b, identifier: YB94076
2026-03-29 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-29 06:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-29 06:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076 to the API
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:38Z',
 'fuel_type': 'diesel',
 'id': '9c30bb17-9073-53c8-a5ed-38c920a8541b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB94076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 232221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-29 06:31:40 [auto1.be] INFO: Saving data for YB94076: {'auction_closing_time': 1774886138.0, 'created_time': 1774643614.667974, 'last_price_update_time': 1774765900.04182}
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB94076') HTTP/1.1" 204 0
2026-03-29 06:31:40 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-29 06:31:40 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-29 06:31:40 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 06:31:40 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 06:31:40 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-29 06:31:40 [auto1.be] INFO: Scrape type for DF96327: 2
2026-03-29 06:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-29 06:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with scrape type 2
2026-03-29 06:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with scrape type 2
2026-03-29 06:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f, identifier: DF96327
2026-03-29 06:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-29 06:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-29 06:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327 to the API
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'diesel',
 'id': '8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF96327',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 171018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-05',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-29 06:31:40 [auto1.be] INFO: Saving data for DF96327: {'auction_closing_time': 1774883752.0, 'created_time': 1774557059.321687, 'last_price_update_time': 1774765900.567921}
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF96327') HTTP/1.1" 204 0
2026-03-29 06:31:40 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-29 06:31:40 [auto1.be] INFO: Scrape type for MC94265: 2
2026-03-29 06:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-29 06:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with scrape type 2
2026-03-29 06:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with scrape type 2
2026-03-29 06:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc, identifier: MC94265
2026-03-29 06:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-29 06:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-29 06:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265 to the API
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'diesel',
 'id': '3d2c4510-6a63-5a2d-ad98-5a094d473ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC94265',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 174400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-05',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-29 06:31:40 [auto1.be] INFO: Saving data for MC94265: {'auction_closing_time': 1774884516.0, 'created_time': 1774557119.770076, 'last_price_update_time': 1774765900.989842}
2026-03-29 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC94265') HTTP/1.1" 204 0
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Scrape type for PK93774: 2
2026-03-29 06:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-29 06:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with scrape type 2
2026-03-29 06:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with scrape type 2
2026-03-29 06:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6, identifier: PK93774
2026-03-29 06:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-29 06:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-29 06:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774 to the API
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': '80540d39-9f1a-5ede-88b3-8ddfc1b51dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK93774',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 17843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-09',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2023}
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Saving data for PK93774: {'auction_closing_time': 1774883806.0, 'created_time': 1773833840.727757, 'last_price_update_time': 1774765901.441375}
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK93774') HTTP/1.1" 204 0
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Scrape type for BT72678: 2
2026-03-29 06:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-29 06:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3fd721-f191-50d4-af38-8d3542965825 with scrape type 2
2026-03-29 06:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3fd721-f191-50d4-af38-8d3542965825 with scrape type 2
2026-03-29 06:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f3fd721-f191-50d4-af38-8d3542965825, identifier: BT72678
2026-03-29 06:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-29 06:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-29 06:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678 to the API
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:04:41Z',
 'fuel_type': 'diesel',
 'id': '9f3fd721-f191-50d4-af38-8d3542965825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT72678',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 53294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'automatic',
 'trim': 'Feel M',
 'year': 2019}
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Saving data for BT72678: {'auction_closing_time': 1774883081.0, 'created_time': 1774557102.712934, 'last_price_update_time': 1774765901.830175}
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT72678') HTTP/1.1" 204 0
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 06:31:41 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-29 06:31:41 [auto1.be] INFO: Scrape type for GS48835: 2
2026-03-29 06:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-29 06:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 760ce312-37f0-5970-81ce-221075de60ae with scrape type 2
2026-03-29 06:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 760ce312-37f0-5970-81ce-221075de60ae with scrape type 2
2026-03-29 06:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 760ce312-37f0-5970-81ce-221075de60ae, identifier: GS48835
2026-03-29 06:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-29 06:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-29 06:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835 to the API
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:29Z',
 'fuel_type': 'diesel',
 'id': '760ce312-37f0-5970-81ce-221075de60ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS48835',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 167666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2019}
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-29 06:31:42 [auto1.be] INFO: Saving data for GS48835: {'auction_closing_time': 1774885769.0, 'created_time': 1774557163.944948, 'last_price_update_time': 1774765902.321159}
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS48835') HTTP/1.1" 204 0
2026-03-29 06:31:42 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-29 06:31:42 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-29 06:31:42 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 06:31:42 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 06:31:42 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-29 06:31:42 [auto1.be] INFO: Scrape type for YD21406: 2
2026-03-29 06:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-29 06:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1634e9f3-cdc8-5904-9a27-46341229dccf with scrape type 2
2026-03-29 06:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1634e9f3-cdc8-5904-9a27-46341229dccf with scrape type 2
2026-03-29 06:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1634e9f3-cdc8-5904-9a27-46341229dccf, identifier: YD21406
2026-03-29 06:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-29 06:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-29 06:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406 to the API
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:48:03Z',
 'fuel_type': 'petrol',
 'id': '1634e9f3-cdc8-5904-9a27-46341229dccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD21406',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 100905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.4 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-29 06:31:42 [auto1.be] INFO: Saving data for YD21406: {'auction_closing_time': 1774885683.0, 'created_time': 1774557177.16566, 'last_price_update_time': 1774765902.844376}
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YD21406') HTTP/1.1" 204 0
2026-03-29 06:31:42 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-29 06:31:42 [auto1.be] INFO: Scrape type for XJ95743: 2
2026-03-29 06:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-29 06:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd746447-b329-5819-9017-79b4d963625a with scrape type 2
2026-03-29 06:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd746447-b329-5819-9017-79b4d963625a with scrape type 2
2026-03-29 06:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd746447-b329-5819-9017-79b4d963625a, identifier: XJ95743
2026-03-29 06:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-29 06:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-29 06:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743 to the API
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:04Z',
 'fuel_type': 'diesel',
 'id': 'cd746447-b329-5819-9017-79b4d963625a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ95743',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 82671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-29 06:31:43 [auto1.be] INFO: Saving data for XJ95743: {'auction_closing_time': 1774886224.0, 'created_time': 1774557238.154345, 'last_price_update_time': 1774765903.322327}
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ95743') HTTP/1.1" 204 0
2026-03-29 06:31:43 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-29 06:31:43 [auto1.be] INFO: Scrape type for DB02418: 2
2026-03-29 06:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-29 06:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41c49b8-0139-5934-9516-e0edf2d68ffc with scrape type 2
2026-03-29 06:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c41c49b8-0139-5934-9516-e0edf2d68ffc with scrape type 2
2026-03-29 06:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c41c49b8-0139-5934-9516-e0edf2d68ffc, identifier: DB02418
2026-03-29 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-29 06:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-29 06:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418 to the API
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:02:10Z',
 'fuel_type': 'diesel',
 'id': 'c41c49b8-0139-5934-9516-e0edf2d68ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB02418',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 206534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2012}
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-29 06:31:43 [auto1.be] INFO: Saving data for DB02418: {'auction_closing_time': 1774882930.0, 'created_time': 1774643644.93607, 'last_price_update_time': 1774765903.733888}
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB02418') HTTP/1.1" 204 0
2026-03-29 06:31:43 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-29 06:31:43 [auto1.be] INFO: Scrape type for XT36171: 2
2026-03-29 06:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-29 06:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 179c51cc-9dad-54e5-903b-355803cbf100 with scrape type 2
2026-03-29 06:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 179c51cc-9dad-54e5-903b-355803cbf100 with scrape type 2
2026-03-29 06:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 179c51cc-9dad-54e5-903b-355803cbf100, identifier: XT36171
2026-03-29 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-29 06:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171 to the API
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:07:39Z',
 'fuel_type': 'gas',
 'id': '179c51cc-9dad-54e5-903b-355803cbf100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT36171',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 65029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Saving data for XT36171: {'auction_closing_time': 1774883259.0, 'created_time': 1773401498.481253, 'last_price_update_time': 1774765904.228282}
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT36171') HTTP/1.1" 204 0
2026-03-29 06:31:44 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for SU72836: 2
2026-03-29 06:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-29 06:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with scrape type 2
2026-03-29 06:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with scrape type 2
2026-03-29 06:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b48de29-6c3c-5d19-996d-b67f94e8fa83, identifier: SU72836
2026-03-29 06:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-29 06:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-29 06:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836 to the API
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:41:56Z',
 'fuel_type': 'diesel',
 'id': '1b48de29-6c3c-5d19-996d-b67f94e8fa83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU72836',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 136454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Saving data for SU72836: {'auction_closing_time': 1774885316.0, 'created_time': 1773922343.923508, 'last_price_update_time': 1774765904.722268}
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU72836') HTTP/1.1" 204 0
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for XC10139: 2
2026-03-29 06:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-29 06:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b722d821-e14d-539a-8136-ef63786faded with scrape type 2
2026-03-29 06:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b722d821-e14d-539a-8136-ef63786faded with scrape type 2
2026-03-29 06:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b722d821-e14d-539a-8136-ef63786faded, identifier: XC10139
2026-03-29 06:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:44 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-29 06:31:44 [auto1.be] INFO: Scrape type for ME81448: 2
2026-03-29 06:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-29 06:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951023aa-d4e4-588c-a776-24f8f81552a2 with scrape type 2
2026-03-29 06:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 951023aa-d4e4-588c-a776-24f8f81552a2 with scrape type 2
2026-03-29 06:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 951023aa-d4e4-588c-a776-24f8f81552a2, identifier: ME81448
2026-03-29 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-29 06:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-29 06:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139 to the API
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': 'b722d821-e14d-539a-8136-ef63786faded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC10139',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 119578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-29 06:31:45 [auto1.be] INFO: Saving data for XC10139: {'auction_closing_time': 1774885124.0, 'created_time': 1774557184.94311, 'last_price_update_time': 1774765905.344631}
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC10139') HTTP/1.1" 204 0
2026-03-29 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-29 06:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-29 06:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448 to the API
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:33Z',
 'fuel_type': 'petrol',
 'id': '951023aa-d4e4-588c-a776-24f8f81552a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME81448',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 49900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-29 06:31:45 [auto1.be] INFO: Saving data for ME81448: {'auction_closing_time': 1774885473.0, 'created_time': 1774643605.028998, 'last_price_update_time': 1774765905.653609}
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME81448') HTTP/1.1" 204 0
2026-03-29 06:31:45 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-29 06:31:45 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-29 06:31:45 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-29 06:31:45 [auto1.be] INFO: Scrape type for RL32581: 2
2026-03-29 06:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-29 06:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620966a7-3c70-5cb5-8c5c-af38cada22a5 with scrape type 2
2026-03-29 06:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 620966a7-3c70-5cb5-8c5c-af38cada22a5 with scrape type 2
2026-03-29 06:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 620966a7-3c70-5cb5-8c5c-af38cada22a5, identifier: RL32581
2026-03-29 06:31:45 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-29 06:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-29 06:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581 to the API
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'petrol',
 'id': '620966a7-3c70-5cb5-8c5c-af38cada22a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL32581',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 105444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Saving data for RL32581: {'auction_closing_time': 1774884638.0, 'created_time': 1773866517.693449, 'last_price_update_time': 1774765906.077234}
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL32581') HTTP/1.1" 204 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for KP16725: 2
2026-03-29 06:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-29 06:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with scrape type 2
2026-03-29 06:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with scrape type 2
2026-03-29 06:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555, identifier: KP16725
2026-03-29 06:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-29 06:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-29 06:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725 to the API
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'diesel',
 'id': '14f4e165-c34a-5cd5-b1b6-03f31b3cf555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16725',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 152527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H2 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H2 2,9t',
 'year': 2018}
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Saving data for KP16725: {'auction_closing_time': 1774883778.0, 'created_time': 1774643552.3746, 'last_price_update_time': 1774765906.574423}
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP16725') HTTP/1.1" 204 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-29 06:31:46 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-29 06:31:46 [auto1.be] INFO: Scrape type for CS46585: 2
2026-03-29 06:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-29 06:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9439004-4fc6-5383-9e68-aa6686a4b734 with scrape type 2
2026-03-29 06:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9439004-4fc6-5383-9e68-aa6686a4b734 with scrape type 2
2026-03-29 06:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9439004-4fc6-5383-9e68-aa6686a4b734, identifier: CS46585
2026-03-29 06:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-29 06:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-29 06:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585 to the API
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:06:56Z',
 'fuel_type': 'petrol',
 'id': 'c9439004-4fc6-5383-9e68-aa6686a4b734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS46585',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 209791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Saving data for CS46585: {'auction_closing_time': 1774883216.0, 'created_time': 1774557140.909173, 'last_price_update_time': 1774765907.241526}
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS46585') HTTP/1.1" 204 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for LP39108: 2
2026-03-29 06:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-29 06:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f9a976-deb2-5b26-aff6-54d606e656f5 with scrape type 2
2026-03-29 06:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1f9a976-deb2-5b26-aff6-54d606e656f5 with scrape type 2
2026-03-29 06:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1f9a976-deb2-5b26-aff6-54d606e656f5, identifier: LP39108
2026-03-29 06:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-29 06:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-29 06:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108 to the API
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'petrol',
 'id': 'f1f9a976-deb2-5b26-aff6-54d606e656f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP39108',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 191515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.4 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Saving data for LP39108: {'auction_closing_time': 1774884544.0, 'created_time': 1774643604.714687, 'last_price_update_time': 1774765907.76111}
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP39108') HTTP/1.1" 204 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-29 06:31:47 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-29 06:31:47 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-29 06:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:48 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-29 06:31:48 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-29 06:31:48 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-29 06:31:48 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-29 06:31:48 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-29 06:31:48 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 06:31:48 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-29 06:31:48 [auto1.be] INFO: Scrape type for AW74184: 2
2026-03-29 06:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-29 06:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27685742-f930-5c5f-94e2-21bc3d30f61d with scrape type 2
2026-03-29 06:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27685742-f930-5c5f-94e2-21bc3d30f61d with scrape type 2
2026-03-29 06:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27685742-f930-5c5f-94e2-21bc3d30f61d, identifier: AW74184
2026-03-29 06:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-29 06:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-29 06:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184 to the API
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'diesel',
 'id': '27685742-f930-5c5f-94e2-21bc3d30f61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW74184',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 146147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Active",
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Saving data for AW74184: {'auction_closing_time': 1774885294.0, 'created_time': 1774643626.940804, 'last_price_update_time': 1774765909.271145}
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AW74184') HTTP/1.1" 204 0
2026-03-29 06:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for UU12218: 2
2026-03-29 06:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-29 06:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with scrape type 2
2026-03-29 06:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with scrape type 2
2026-03-29 06:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e, identifier: UU12218
2026-03-29 06:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-29 06:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-29 06:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218 to the API
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:17Z',
 'fuel_type': 'diesel',
 'id': 'd2f22d05-cfdf-5018-9cd9-dbfd2cd5585e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU12218',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-31',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Saving data for UU12218: {'auction_closing_time': 1774883597.0, 'created_time': 1774643642.26628, 'last_price_update_time': 1774765909.907096}
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU12218') HTTP/1.1" 204 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 06:31:49 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-29 06:31:49 [auto1.be] INFO: Scrape type for PB25162: 2
2026-03-29 06:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-29 06:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77863e2a-4114-5928-bcad-56eaadd19805 with scrape type 2
2026-03-29 06:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77863e2a-4114-5928-bcad-56eaadd19805 with scrape type 2
2026-03-29 06:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77863e2a-4114-5928-bcad-56eaadd19805, identifier: PB25162
2026-03-29 06:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-29 06:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-29 06:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162 to the API
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:22:17Z',
 'fuel_type': 'petrol',
 'id': '77863e2a-4114-5928-bcad-56eaadd19805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB25162',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 15780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-04',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2023}
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Saving data for PB25162: {'auction_closing_time': 1774884137.0, 'created_time': 1774643684.869381, 'last_price_update_time': 1774765910.311689}
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB25162') HTTP/1.1" 204 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-29 06:31:50 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Scrape type for RR89556: 2
2026-03-29 06:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-29 06:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with scrape type 2
2026-03-29 06:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with scrape type 2
2026-03-29 06:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29d8319a-52dc-5975-a22f-1e0071b3a6e5, identifier: RR89556
2026-03-29 06:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-29 06:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-29 06:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556 to the API
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:42:42Z',
 'fuel_type': 'petrol',
 'id': '29d8319a-52dc-5975-a22f-1e0071b3a6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR89556',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 19110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-29 06:31:50 [auto1.be] INFO: Saving data for RR89556: {'auction_closing_time': 1774885362.0, 'created_time': 1774557195.308689, 'last_price_update_time': 1774765910.915599}
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR89556') HTTP/1.1" 204 0
2026-03-29 06:31:51 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 06:31:51 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 06:31:51 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 06:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:52 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-29 06:31:52 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-29 06:31:52 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-29 06:31:52 [auto1.be] INFO: Scrape type for MV82025: 2
2026-03-29 06:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-29 06:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71215794-5397-5401-80c2-2542c4e8b4b2 with scrape type 2
2026-03-29 06:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71215794-5397-5401-80c2-2542c4e8b4b2 with scrape type 2
2026-03-29 06:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71215794-5397-5401-80c2-2542c4e8b4b2, identifier: MV82025
2026-03-29 06:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-29 06:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-29 06:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025 to the API
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:12:44Z',
 'fuel_type': 'petrol',
 'id': '71215794-5397-5401-80c2-2542c4e8b4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV82025',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 117875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-16',
 'seller_name': None,
 'title': 'Kia Rio 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-29 06:31:52 [auto1.be] INFO: Saving data for MV82025: {'auction_closing_time': 1774883564.0, 'created_time': 1774643672.972189, 'last_price_update_time': 1774765912.825637}
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV82025') HTTP/1.1" 204 0
2026-03-29 06:31:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-29 06:31:52 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 06:31:52 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-29 06:31:52 [auto1.be] INFO: Scrape type for ET79377: 2
2026-03-29 06:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-29 06:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f3b38-33fa-5979-8f6c-8461ef873c8f with scrape type 2
2026-03-29 06:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd6f3b38-33fa-5979-8f6c-8461ef873c8f with scrape type 2
2026-03-29 06:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd6f3b38-33fa-5979-8f6c-8461ef873c8f, identifier: ET79377
2026-03-29 06:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-29 06:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-29 06:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377 to the API
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:10:35Z',
 'fuel_type': 'diesel',
 'id': 'bd6f3b38-33fa-5979-8f6c-8461ef873c8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET79377',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 170186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-17',
 'seller_name': None,
 'title': 'BMW 4er 430d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Saving data for ET79377: {'auction_closing_time': 1774883435.0, 'created_time': 1773909031.458779, 'last_price_update_time': 1774765913.269253}
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET79377') HTTP/1.1" 204 0
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Scrape type for UR44884: 2
2026-03-29 06:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-29 06:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006e77a7-b816-5d8f-903f-13762796f2d2 with scrape type 2
2026-03-29 06:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006e77a7-b816-5d8f-903f-13762796f2d2 with scrape type 2
2026-03-29 06:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 006e77a7-b816-5d8f-903f-13762796f2d2, identifier: UR44884
2026-03-29 06:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-29 06:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-29 06:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884 to the API
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': '006e77a7-b816-5d8f-903f-13762796f2d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR44884',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 29909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Saving data for UR44884: {'auction_closing_time': 1774885227.0, 'created_time': 1774557206.163541, 'last_price_update_time': 1774765913.750861}
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR44884') HTTP/1.1" 204 0
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 06:31:53 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-29 06:31:53 [auto1.be] INFO: Scrape type for WK50026: 2
2026-03-29 06:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-29 06:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a916bf6-add1-537b-9d8a-3fb9c166f590 with scrape type 2
2026-03-29 06:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a916bf6-add1-537b-9d8a-3fb9c166f590 with scrape type 2
2026-03-29 06:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a916bf6-add1-537b-9d8a-3fb9c166f590, identifier: WK50026
2026-03-29 06:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-29 06:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-29 06:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026 to the API
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:23Z',
 'fuel_type': 'petrol',
 'id': '5a916bf6-add1-537b-9d8a-3fb9c166f590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK50026',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2016}
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-29 06:31:54 [auto1.be] INFO: Saving data for WK50026: {'auction_closing_time': 1774885343.0, 'created_time': 1773133087.392684, 'last_price_update_time': 1774765914.239381}
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK50026') HTTP/1.1" 204 0
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-29 06:31:54 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-29 06:31:54 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-29 06:31:54 [auto1.be] INFO: Scrape type for RF74485: 2
2026-03-29 06:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-29 06:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893943d4-e5ea-5829-8278-50cb4a6de35c with scrape type 2
2026-03-29 06:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893943d4-e5ea-5829-8278-50cb4a6de35c with scrape type 2
2026-03-29 06:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 893943d4-e5ea-5829-8278-50cb4a6de35c, identifier: RF74485
2026-03-29 06:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-29 06:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-29 06:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485 to the API
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:46:30Z',
 'fuel_type': 'petrol',
 'id': '893943d4-e5ea-5829-8278-50cb4a6de35c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF74485',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 120277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-18',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2010}
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-29 06:31:54 [auto1.be] INFO: Saving data for RF74485: {'auction_closing_time': 1774885590.0, 'created_time': 1774557124.322943, 'last_price_update_time': 1774765914.758745}
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF74485') HTTP/1.1" 204 0
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 06:31:54 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-29 06:31:54 [auto1.be] INFO: Scrape type for MU18005: 2
2026-03-29 06:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-29 06:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with scrape type 2
2026-03-29 06:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with scrape type 2
2026-03-29 06:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11, identifier: MU18005
2026-03-29 06:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-29 06:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-29 06:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005 to the API
2026-03-29 06:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:50Z',
 'fuel_type': 'diesel',
 'id': 'ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU18005',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 162262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2016}
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Saving data for MU18005: {'auction_closing_time': 1774884170.0, 'created_time': 1774557170.686852, 'last_price_update_time': 1774765915.186617}
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU18005') HTTP/1.1" 204 0
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Scrape type for KV94769: 2
2026-03-29 06:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-29 06:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9bc0b34-3b35-5969-bb19-c15d82005856 with scrape type 2
2026-03-29 06:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9bc0b34-3b35-5969-bb19-c15d82005856 with scrape type 2
2026-03-29 06:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9bc0b34-3b35-5969-bb19-c15d82005856, identifier: KV94769
2026-03-29 06:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-29 06:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-29 06:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769 to the API
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'd9bc0b34-3b35-5969-bb19-c15d82005856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV94769',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-03',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2023}
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Saving data for KV94769: {'auction_closing_time': 1774883429.0, 'created_time': 1774557227.408771, 'last_price_update_time': 1774765915.596539}
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV94769') HTTP/1.1" 204 0
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 06:31:55 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-29 06:31:55 [auto1.be] INFO: Scrape type for FM00077: 2
2026-03-29 06:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-29 06:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c62131b-6bd9-5295-bb76-6402d0846a1d with scrape type 2
2026-03-29 06:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c62131b-6bd9-5295-bb76-6402d0846a1d with scrape type 2
2026-03-29 06:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c62131b-6bd9-5295-bb76-6402d0846a1d, identifier: FM00077
2026-03-29 06:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-29 06:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-29 06:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077 to the API
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:04:46Z',
 'fuel_type': 'diesel',
 'id': '2c62131b-6bd9-5295-bb76-6402d0846a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM00077',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 129301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-29 06:31:56 [auto1.be] INFO: Saving data for FM00077: {'auction_closing_time': 1774883086.0, 'created_time': 1774254698.200148, 'last_price_update_time': 1774765916.100157}
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM00077') HTTP/1.1" 204 0
2026-03-29 06:31:56 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-29 06:31:56 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-29 06:31:56 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 06:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:31:56 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1093 | hits on page: 40
2026-03-29 06:31:56 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 06:31:56 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-29 06:31:56 [auto1.be] INFO: Scrape type for RK82839: 2
2026-03-29 06:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-29 06:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff44973-eac5-5cf4-8615-308de1b32056 with scrape type 2
2026-03-29 06:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff44973-eac5-5cf4-8615-308de1b32056 with scrape type 2
2026-03-29 06:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ff44973-eac5-5cf4-8615-308de1b32056, identifier: RK82839
2026-03-29 06:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-29 06:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-29 06:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839 to the API
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'diesel',
 'id': '1ff44973-eac5-5cf4-8615-308de1b32056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK82839',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 253653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-29 06:31:56 [auto1.be] INFO: Saving data for RK82839: {'auction_closing_time': 1774885289.0, 'created_time': 1774557030.721367, 'last_price_update_time': 1774765916.710155}
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK82839') HTTP/1.1" 204 0
2026-03-29 06:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:31:56 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-29 06:31:56 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-29 06:31:56 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-29 06:31:56 [auto1.be] INFO: Scrape type for CN29269: 2
2026-03-29 06:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-29 06:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with scrape type 2
2026-03-29 06:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with scrape type 2
2026-03-29 06:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4, identifier: CN29269
2026-03-29 06:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-29 06:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-29 06:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269 to the API
2026-03-29 06:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:33:37Z',
 'fuel_type': 'diesel',
 'id': 'ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN29269',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 143734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-30',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Saving data for CN29269: {'auction_closing_time': 1774884817.0, 'created_time': 1774557184.009502, 'last_price_update_time': 1774765917.162807}
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN29269') HTTP/1.1" 204 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for HE95946: 2
2026-03-29 06:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-29 06:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956b7619-a748-5320-baf7-af177a9a6368 with scrape type 2
2026-03-29 06:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956b7619-a748-5320-baf7-af177a9a6368 with scrape type 2
2026-03-29 06:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 956b7619-a748-5320-baf7-af177a9a6368, identifier: HE95946
2026-03-29 06:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-29 06:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-29 06:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946 to the API
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:40Z',
 'fuel_type': 'petrol',
 'id': '956b7619-a748-5320-baf7-af177a9a6368',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE95946',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-06',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Saving data for HE95946: {'auction_closing_time': 1774885360.0, 'created_time': 1774557207.996509, 'last_price_update_time': 1774765917.596848}
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE95946') HTTP/1.1" 204 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for DJ08738: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for SN22557: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-29 06:31:57 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-29 06:31:57 [auto1.be] INFO: Scrape type for FW88759: 2
2026-03-29 06:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-29 06:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9935248-4413-5eec-a9b4-2094f8739f77 with scrape type 2
2026-03-29 06:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9935248-4413-5eec-a9b4-2094f8739f77 with scrape type 2
2026-03-29 06:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9935248-4413-5eec-a9b4-2094f8739f77, identifier: FW88759
2026-03-29 06:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-29 06:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-29 06:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759 to the API
2026-03-29 06:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:35Z',
 'fuel_type': 'diesel',
 'id': 'a9935248-4413-5eec-a9b4-2094f8739f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW88759',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 119748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Saving data for FW88759: {'auction_closing_time': 1774883255.0, 'created_time': 1774557249.17155, 'last_price_update_time': 1774765918.166086}
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW88759') HTTP/1.1" 204 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for PS82481: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for WL68728: 2
2026-03-29 06:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-29 06:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dcb4611-7b89-5852-bbde-a372106c0a9d with scrape type 2
2026-03-29 06:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dcb4611-7b89-5852-bbde-a372106c0a9d with scrape type 2
2026-03-29 06:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6dcb4611-7b89-5852-bbde-a372106c0a9d, identifier: WL68728
2026-03-29 06:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-29 06:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-29 06:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728 to the API
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'petrol',
 'id': '6dcb4611-7b89-5852-bbde-a372106c0a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL68728',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 162154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-22',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2006}
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Saving data for WL68728: {'auction_closing_time': 1774884856.0, 'created_time': 1774557188.44586, 'last_price_update_time': 1774765918.697985}
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL68728') HTTP/1.1" 204 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for AZ39903: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for NL83155: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for PF94112: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for XT95399: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for NT98676: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for ZA12378: 0
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 06:31:58 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-29 06:31:58 [auto1.be] INFO: Scrape type for FJ54867: 0
2026-03-29 06:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:00 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA04427%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for FA04427: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for KD88013: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for YY44687: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for BX66623: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ37001%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for NJ37001: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for DM24490: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for PM87207: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for XW30503: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for UE36464: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for ER02883: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for HT18059: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for PE64709: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for ZM05640: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for KT01454: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for AC59433: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for GM68229: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for LK30146: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for UA37218: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for NZ75648: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for ER91021: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-29 06:32:00 [auto1.be] INFO: Scrape type for EM88075: 0
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 06:32:00 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 06:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:01 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for UV16393: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for AY92488: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for RL22884: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for WH35268: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for DZ29736: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for ZN30582: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for DW89604: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for JB30712: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for XK23104: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for SG83875: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for UM29446: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for XS20349: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for TA24587: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for MM51411: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for EM05161: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for DP44577: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for KU92863: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for XU79591: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for LM11563: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for VZ26705: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for GW19918: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for UY14877: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for GN49517: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for BE30988: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-29 06:32:01 [auto1.be] INFO: Scrape type for LA99224: 0
2026-03-29 06:32:01 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 06:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:02 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:02 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-29 06:32:02 [auto1.be] INFO: Scrape type for GJ36560: 0
2026-03-29 06:32:02 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 06:32:02 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for ER36240: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for SD86163: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for BT92464: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for KG93945: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for HJ19751: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for JJ70860: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for JR09444: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for ET82729: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for HL00392: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for AU29077: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for FL05782: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for UY27001: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for CM21252: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for SU85893: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for DT20121: 0
2026-03-29 06:32:03 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-29 06:32:03 [auto1.be] INFO: Scrape type for VM76060: 0
2026-03-29 06:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:07 [scrapy.extensions.logstats] INFO: Crawled 27 pages (at 13 pages/min), scraped 134 items (at 71 items/min)
2026-03-29 06:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 06:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:34 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for TJ00131: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for VY36246: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for MJ04907: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for YG03175: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for UG65181: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for KT35610: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for GH80996: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for ZY24236: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for ZZ74713: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for XD67660: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for DT55223: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for EL95031: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for UX01518: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for EK14732: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for UR02836: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for VX51166: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for BD29807: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for ZJ26009: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for LR36013: 0
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 06:32:34 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-29 06:32:34 [auto1.be] INFO: Scrape type for TX50404: 0
2026-03-29 06:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:36 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for HR69689: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for FC15884: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for KX73156: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for CA73486: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for NU74968: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for WX14373: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for SW60531: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for JJ51820: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for KH65741: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for CV58665: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for NE94103: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for RC51689: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for KB41449: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for JU94491: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-29 06:32:36 [auto1.be] INFO: Scrape type for PU93740: 0
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 06:32:36 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 06:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:37 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for GV92885: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for DV83163: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for AF15006: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for JY19882: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for JZ80953: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for TL44110: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for FC31614: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for CU06988: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for KH04328: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for GN32494: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for LA84805: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for RX31058: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for BB55914: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for KC67497: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for US61346: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for SY12350: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-29 06:32:37 [auto1.be] INFO: Scrape type for ST29091: 0
2026-03-29 06:32:37 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 06:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-29 06:32:38 [auto1.be] INFO: Scrape type for TV57254: 0
2026-03-29 06:32:38 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 06:32:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:39 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1093 | hits on page: 40
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for RF01360: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for UU14069: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for XG78459: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for RC25321: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for YZ86935: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for XB72565: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for PV46198: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for XX22473: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for YA99172: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for PD03709: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 06:32:39 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-29 06:32:39 [auto1.be] INFO: Scrape type for WY04920: 0
2026-03-29 06:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:41 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1093 | hits on page: 13
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-29 06:32:41 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-29 06:32:41 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-29 06:32:41 [auto1.be] INFO: Scrape type for SJ57770: 0
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 06:32:41 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-29 06:32:41 [auto1.be] INFO: Scrape type for AB83336: 2
2026-03-29 06:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-29 06:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d949308-da85-51a3-8bc7-d5dee023bb14 with scrape type 2
2026-03-29 06:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d949308-da85-51a3-8bc7-d5dee023bb14 with scrape type 2
2026-03-29 06:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d949308-da85-51a3-8bc7-d5dee023bb14, identifier: AB83336
2026-03-29 06:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-29 06:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-29 06:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336 to the API
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'diesel',
 'id': '9d949308-da85-51a3-8bc7-d5dee023bb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB83336',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 168842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 319 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-29 06:32:42 [auto1.be] INFO: Saving data for AB83336: {'auction_closing_time': 1774884339.0, 'created_time': 1774265473.136375, 'last_price_update_time': 1774765962.757905}
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB83336') HTTP/1.1" 204 0
2026-03-29 06:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:32:42 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-29 06:32:42 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-29 06:32:42 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 06:32:42 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-29 06:32:42 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-29 06:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:32:43 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1093 | hits on page: 0
2026-03-29 06:32:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 06:32:43 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-29 06:32:43 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774333963 HTTP/1.1" 200 None
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AP41069') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AR32525') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AT63979') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AW85070') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AX85813') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AY81363') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BB03728') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BD75766') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BG28047') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BG48635') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ66771') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BS63572') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BT79148') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BU87494') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BW78090') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CG06920') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CG30314') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CJ47439') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CK09139') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CM27580') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CN63024') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CX41368') HTTP/1.1" 204 0
2026-03-29 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DB86254') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DE57116') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DF27796') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DK56299') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DP09224') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DV05608') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DY61715') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ04069') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EH00649') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EL15919') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EW74557') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EY30158') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28450') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ39341') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FN94625') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FU36537') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GB08882') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GP47231') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GR20506') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GR73680') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GT54802') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HG96847') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HH58187') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ18768') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HK17883') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HW27087') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JH54143') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JU34777') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JV87327') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JX62386') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KC96142') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KM90299') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KV08119') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KX52505') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LA02841') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LM86874') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LN66579') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LU52331') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LX63677') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MC38838') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MC39909') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MD26549') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MK43253') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MP85274') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MW28433') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PK62026') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PM01879') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PP09474') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PS52257') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RA43881') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ02642') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ66684') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RK38096') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RL40953') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RN18348') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RP07829') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RX49732') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SA25365') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SC59863') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SF53874') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SG70291') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SH24998') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SL38260') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SR07262') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SS16880') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SU09298') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SX31062') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SY45354') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TF44049') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TT44522') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TX24621') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UA60299') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UF50418') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VF07698') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VG64593') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VK84841') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP74122') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VU75428') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VX08481') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VX60737') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WB75664') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WH82080') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WP48113') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WP78521') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WS79508') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WW95271') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ84600') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XD20016') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ87456') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XM11167') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XX29413') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YC67268') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ65498') HTTP/1.1" 204 0
2026-03-29 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YS96086') HTTP/1.1" 204 0
2026-03-29 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YY24576') HTTP/1.1" 204 0
2026-03-29 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD00943') HTTP/1.1" 204 0
2026-03-29 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD35618') HTTP/1.1" 204 0
2026-03-29 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU55042') HTTP/1.1" 204 0
2026-03-29 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX73243') HTTP/1.1" 204 0
2026-03-29 06:32:45 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (135 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-29T06_30_00.jl
2026-03-29 06:32:45 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 90513,
 'downloader/request_count': 33,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 31,
 'downloader/response_bytes': 5238268,
 'downloader/response_count': 33,
 'downloader/response_status_count/200': 33,
 'elapsed_time_seconds': 158.005089,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 6, 32, 45, 37613, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 135,
 'log_count/DEBUG': 2346,
 'log_count/INFO': 2883,
 'memusage/max': 164904960,
 'memusage/startup': 149569536,
 'request_depth_max': 32,
 'response_received_count': 33,
 'scheduler/dequeued': 33,
 'scheduler/dequeued/memory': 33,
 'scheduler/enqueued': 33,
 'scheduler/enqueued/memory': 33,
 'scrape_type/batch_skipped': 555,
 'scrape_type/price_update': 135,
 'scrape_type/skipped': 443,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 33,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.7000795274154474,
 'scrapy-zyte-api/mean_response_seconds': 3.8188145050750766,
 'scrapy-zyte-api/processed': 33,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 33,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 32,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 33,
 'scrapy-zyte-api/request_args/httpRequestBody': 31,
 'scrapy-zyte-api/request_args/httpRequestMethod': 31,
 'scrapy-zyte-api/request_args/httpResponseBody': 33,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 33,
 'scrapy-zyte-api/request_args/sessionContext': 33,
 'scrapy-zyte-api/request_args/url': 33,
 'scrapy-zyte-api/status_codes/200': 33,
 'scrapy-zyte-api/success': 33,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1133,
 'source/total_available': 1093,
 'start_time': datetime.datetime(2026, 3, 29, 6, 30, 7, 32524, tzinfo=datetime.timezone.utc)}
2026-03-29 06:32:45 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 06:32:45 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa75fab2e90>
2026-03-29 06:32:45 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa75fc5bfd0>