2026-03-29 06:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 06:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 06:35:05 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-29 06:35:05 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 06:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 06:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 06:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 06:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 06:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: 2ea554a72d91b0a6
2026-03-29 06:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 06:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-29T06_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 06:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 06:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 06:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 06:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 06:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 06:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-29 06:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 06:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 06:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 06:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 06:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 06:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 06:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 06:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 06:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 06:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 06:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 06:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 06:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 06:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 06:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 06:35:18 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for ZU13483: 2
2026-03-29 06:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-29 06:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with scrape type 2
2026-03-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with scrape type 2
2026-03-29 06:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981, identifier: ZU13483
2026-03-29 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-29 06:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483 to the API
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'diesel',
 'id': '22e8a7fe-0993-5ecf-a4c0-096bbedfa981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU13483',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 209620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-02',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Saving data for ZU13483: {'auction_closing_time': 1774885120.0, 'created_time': 1774643810.612907, 'last_price_update_time': 1774766118.860939}
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU13483') HTTP/1.1" 204 0
2026-03-29 06:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-29 06:35:18 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-29 06:35:18 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for CC85070: 2
2026-03-29 06:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-29 06:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d62c776-1845-5548-aec3-c1ce832c593e with scrape type 2
2026-03-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d62c776-1845-5548-aec3-c1ce832c593e with scrape type 2
2026-03-29 06:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d62c776-1845-5548-aec3-c1ce832c593e, identifier: CC85070
2026-03-29 06:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 06:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-29 06:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070 to the API
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:19:50Z',
 'fuel_type': 'diesel',
 'id': '5d62c776-1845-5548-aec3-c1ce832c593e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC85070',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 146976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Kia Rio 1.4 CRDi Platinum Edition',
 'transmission': 'manual',
 'trim': 'Platinum Edition',
 'year': 2017}
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Saving data for CC85070: {'auction_closing_time': 1774883990.0, 'created_time': 1774643898.572376, 'last_price_update_time': 1774766119.660629}
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC85070') HTTP/1.1" 204 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-29 06:35:19 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-29 06:35:19 [auto1.be] INFO: Scrape type for SR49598: 2
2026-03-29 06:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-29 06:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497af0eb-e19b-5f91-ad5a-aa140478438e with scrape type 2
2026-03-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497af0eb-e19b-5f91-ad5a-aa140478438e with scrape type 2
2026-03-29 06:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 497af0eb-e19b-5f91-ad5a-aa140478438e, identifier: SR49598
2026-03-29 06:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-29 06:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-29 06:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598 to the API
2026-03-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'diesel',
 'id': '497af0eb-e19b-5f91-ad5a-aa140478438e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR49598',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 165232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-29 06:35:20 [auto1.be] INFO: Saving data for SR49598: {'auction_closing_time': 1774885534.0, 'created_time': 1773909326.499568, 'last_price_update_time': 1774766120.177111}
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR49598') HTTP/1.1" 204 0
2026-03-29 06:35:20 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 06:35:20 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-29 06:35:20 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-29 06:35:20 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 06:35:20 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-29 06:35:20 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-29 06:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:21 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 06:35:21 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-29 06:35:21 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-29 06:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:22 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:22 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 06:35:22 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-29 06:35:22 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-29 06:35:22 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 06:35:22 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 06:35:22 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 06:35:22 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-29 06:35:22 [auto1.be] INFO: Scrape type for XZ48466: 2
2026-03-29 06:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-29 06:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d284c50-6d79-5bb3-af67-aed85c560e66 with scrape type 2
2026-03-29 06:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d284c50-6d79-5bb3-af67-aed85c560e66 with scrape type 2
2026-03-29 06:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d284c50-6d79-5bb3-af67-aed85c560e66, identifier: XZ48466
2026-03-29 06:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 06:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-29 06:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466 to the API
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:09:58Z',
 'fuel_type': 'petrol',
 'id': '8d284c50-6d79-5bb3-af67-aed85c560e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ48466',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 151715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2009}
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Saving data for XZ48466: {'auction_closing_time': 1774883398.0, 'created_time': 1774643970.568567, 'last_price_update_time': 1774766123.194316}
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ48466') HTTP/1.1" 204 0
2026-03-29 06:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for WE70666: 2
2026-03-29 06:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-29 06:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed47b16-c131-53a7-a3d0-b7cd0c941363 with scrape type 2
2026-03-29 06:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eed47b16-c131-53a7-a3d0-b7cd0c941363 with scrape type 2
2026-03-29 06:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eed47b16-c131-53a7-a3d0-b7cd0c941363, identifier: WE70666
2026-03-29 06:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-29 06:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-29 06:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666 to the API
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:14:10Z',
 'fuel_type': 'petrol',
 'id': 'eed47b16-c131-53a7-a3d0-b7cd0c941363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE70666',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 71558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Saving data for WE70666: {'auction_closing_time': 1774883650.0, 'created_time': 1773747359.176413, 'last_price_update_time': 1774766123.833241}
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE70666') HTTP/1.1" 204 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-29 06:35:23 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 06:35:23 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-29 06:35:24 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-29 06:35:24 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-29 06:35:24 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-29 06:35:24 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-29 06:35:24 [auto1.be] INFO: Scrape type for SD77902: 2
2026-03-29 06:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-29 06:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3858bf66-719b-5ee3-a92c-0e3d097032db with scrape type 2
2026-03-29 06:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3858bf66-719b-5ee3-a92c-0e3d097032db with scrape type 2
2026-03-29 06:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3858bf66-719b-5ee3-a92c-0e3d097032db, identifier: SD77902
2026-03-29 06:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-29 06:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-29 06:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902 to the API
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:03:49Z',
 'fuel_type': 'diesel',
 'id': '3858bf66-719b-5ee3-a92c-0e3d097032db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD77902',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 220247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel',
 'transmission': 'manual',
 'trim': 'Travel',
 'year': 2010}
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-29 06:35:24 [auto1.be] INFO: Saving data for SD77902: {'auction_closing_time': 1774883029.0, 'created_time': 1774644017.628546, 'last_price_update_time': 1774766124.444796}
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD77902') HTTP/1.1" 204 0
2026-03-29 06:35:24 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 06:35:24 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-29 06:35:24 [auto1.be] INFO: Scrape type for EK72945: 2
2026-03-29 06:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-29 06:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ed6b60-6709-5554-b716-4d6806724a89 with scrape type 2
2026-03-29 06:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ed6b60-6709-5554-b716-4d6806724a89 with scrape type 2
2026-03-29 06:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d5ed6b60-6709-5554-b716-4d6806724a89, identifier: EK72945
2026-03-29 06:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-29 06:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-29 06:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945 to the API
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:56:41Z',
 'fuel_type': 'petrol',
 'id': 'd5ed6b60-6709-5554-b716-4d6806724a89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK72945',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 157243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-09',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2014}
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-29 06:35:24 [auto1.be] INFO: Saving data for EK72945: {'auction_closing_time': 1774886201.0, 'created_time': 1773134803.074061, 'last_price_update_time': 1774766124.971072}
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK72945') HTTP/1.1" 204 0
2026-03-29 06:35:24 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 06:35:24 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-29 06:35:25 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-29 06:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:26 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:26 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 06:35:26 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-29 06:35:26 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-29 06:35:26 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 06:35:26 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-29 06:35:26 [auto1.be] INFO: Scrape type for WJ85942: 2
2026-03-29 06:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-29 06:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 with scrape type 2
2026-03-29 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 with scrape type 2
2026-03-29 06:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a29a99ba-c57d-5253-ae98-692c57ecd3b3, identifier: WJ85942
2026-03-29 06:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 06:35:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-29 06:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942 to the API
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:12:57Z',
 'fuel_type': 'diesel',
 'id': 'a29a99ba-c57d-5253-ae98-692c57ecd3b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ85942',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 82952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L1 Premium',
 'transmission': 'manual',
 'trim': 'L1 Premium',
 'year': 2018}
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-29 06:35:26 [auto1.be] INFO: Saving data for WJ85942: {'auction_closing_time': 1774883577.0, 'created_time': 1774643960.031396, 'last_price_update_time': 1774766126.956889}
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ85942') HTTP/1.1" 204 0
2026-03-29 06:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:26 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-29 06:35:26 [auto1.be] INFO: Scrape type for ZL62218: 0
2026-03-29 06:35:26 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-29 06:35:27 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-29 06:35:27 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-29 06:35:27 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-29 06:35:27 [auto1.be] INFO: Scrape type for JB70681: 2
2026-03-29 06:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-29 06:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with scrape type 2
2026-03-29 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with scrape type 2
2026-03-29 06:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8, identifier: JB70681
2026-03-29 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-29 06:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-29 06:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681 to the API
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'petrol',
 'id': 'ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB70681',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 121416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-02',
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-29 06:35:27 [auto1.be] INFO: Saving data for JB70681: {'auction_closing_time': 1774883697.0, 'created_time': 1774643915.864878, 'last_price_update_time': 1774766127.456308}
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB70681') HTTP/1.1" 204 0
2026-03-29 06:35:27 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-29 06:35:27 [auto1.be] INFO: Scrape type for JS91755: 2
2026-03-29 06:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-29 06:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with scrape type 2
2026-03-29 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with scrape type 2
2026-03-29 06:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc, identifier: JS91755
2026-03-29 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-29 06:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755 to the API
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:07Z',
 'fuel_type': 'diesel',
 'id': '4c6c3904-b97d-5ba7-a81b-20e6b5724bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS91755',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 243744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2014}
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Saving data for JS91755: {'auction_closing_time': 1774883647.0, 'created_time': 1773240662.024707, 'last_price_update_time': 1774766128.098869}
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS91755') HTTP/1.1" 204 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for NV81106: 2
2026-03-29 06:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-29 06:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3732b551-8397-54e7-ac71-594bf19ce099 with scrape type 2
2026-03-29 06:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3732b551-8397-54e7-ac71-594bf19ce099 with scrape type 2
2026-03-29 06:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3732b551-8397-54e7-ac71-594bf19ce099, identifier: NV81106
2026-03-29 06:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-29 06:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-29 06:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106 to the API
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': '3732b551-8397-54e7-ac71-594bf19ce099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV81106',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Saving data for NV81106: {'auction_closing_time': 1774884777.0, 'created_time': 1773224675.537605, 'last_price_update_time': 1774766128.665461}
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV81106') HTTP/1.1" 204 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-29 06:35:28 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 06:35:28 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:29 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:29 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-29 06:35:29 [auto1.be] INFO: Scrape type for AA49507: 2
2026-03-29 06:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-29 06:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 with scrape type 2
2026-03-29 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 with scrape type 2
2026-03-29 06:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 113c6d87-a1cf-5b58-b394-de32dd3d7393, identifier: AA49507
2026-03-29 06:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-29 06:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-29 06:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507 to the API
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:07Z',
 'fuel_type': 'petrol',
 'id': '113c6d87-a1cf-5b58-b394-de32dd3d7393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA49507',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 169803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2008}
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-29 06:35:30 [auto1.be] INFO: Saving data for AA49507: {'auction_closing_time': 1774884127.0, 'created_time': 1774643810.103388, 'last_price_update_time': 1774766130.353012}
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AA49507') HTTP/1.1" 204 0
2026-03-29 06:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-29 06:35:30 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-29 06:35:30 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-29 06:35:30 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-29 06:35:30 [auto1.be] INFO: Scrape type for BA52354: 2
2026-03-29 06:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-29 06:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with scrape type 2
2026-03-29 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with scrape type 2
2026-03-29 06:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f, identifier: BA52354
2026-03-29 06:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-29 06:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-29 06:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354 to the API
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:29Z',
 'fuel_type': 'petrol',
 'id': '6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA52354',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 252394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-10',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-29 06:35:30 [auto1.be] INFO: Saving data for BA52354: {'auction_closing_time': 1774883489.0, 'created_time': 1773434498.091555, 'last_price_update_time': 1774766130.893346}
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA52354') HTTP/1.1" 204 0
2026-03-29 06:35:31 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 06:35:31 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 06:35:31 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 06:35:31 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-29 06:35:31 [auto1.be] INFO: Scrape type for UC23117: 2
2026-03-29 06:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-29 06:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69a1ffc-e570-5729-b9e0-495f719664ad with scrape type 2
2026-03-29 06:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69a1ffc-e570-5729-b9e0-495f719664ad with scrape type 2
2026-03-29 06:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c69a1ffc-e570-5729-b9e0-495f719664ad, identifier: UC23117
2026-03-29 06:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-29 06:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-29 06:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117 to the API
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-30T15:33:37Z',
 'fuel_type': 'petrol',
 'id': 'c69a1ffc-e570-5729-b9e0-495f719664ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC23117',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 48513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-29 06:35:31 [auto1.be] INFO: Saving data for UC23117: {'auction_closing_time': 1774884817.0, 'created_time': 1774557330.897999, 'last_price_update_time': 1774766131.568322}
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC23117') HTTP/1.1" 204 0
2026-03-29 06:35:31 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-29 06:35:31 [auto1.be] INFO: Scrape type for RS46918: 2
2026-03-29 06:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-29 06:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with scrape type 2
2026-03-29 06:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with scrape type 2
2026-03-29 06:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1, identifier: RS46918
2026-03-29 06:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-29 06:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-29 06:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918 to the API
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'petrol',
 'id': '071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS46918',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 31878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Saving data for RS46918: {'auction_closing_time': 1774884968.0, 'created_time': 1774644003.566721, 'last_price_update_time': 1774766132.034508}
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS46918') HTTP/1.1" 204 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for GF24104: 2
2026-03-29 06:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-29 06:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92561579-2897-5a8e-bbd2-8a9c08ff274a with scrape type 2
2026-03-29 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92561579-2897-5a8e-bbd2-8a9c08ff274a with scrape type 2
2026-03-29 06:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92561579-2897-5a8e-bbd2-8a9c08ff274a, identifier: GF24104
2026-03-29 06:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-29 06:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-29 06:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104 to the API
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:32Z',
 'fuel_type': 'diesel',
 'id': '92561579-2897-5a8e-bbd2-8a9c08ff274a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF24104',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 186938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Saving data for GF24104: {'auction_closing_time': 1774883132.0, 'created_time': 1774643987.368553, 'last_price_update_time': 1774766132.444966}
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF24104') HTTP/1.1" 204 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for PJ82537: 2
2026-03-29 06:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-29 06:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45fcdd64-6b7c-50e9-934f-6137291a16a3 with scrape type 2
2026-03-29 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45fcdd64-6b7c-50e9-934f-6137291a16a3 with scrape type 2
2026-03-29 06:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45fcdd64-6b7c-50e9-934f-6137291a16a3, identifier: PJ82537
2026-03-29 06:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-29 06:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-29 06:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537 to the API
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'petrol',
 'id': '45fcdd64-6b7c-50e9-934f-6137291a16a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ82537',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 23545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-20',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Saving data for PJ82537: {'auction_closing_time': 1774885715.0, 'created_time': 1774643916.637018, 'last_price_update_time': 1774766132.868507}
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ82537') HTTP/1.1" 204 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 06:35:32 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-29 06:35:32 [auto1.be] INFO: Scrape type for YP74524: 2
2026-03-29 06:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-29 06:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with scrape type 2
2026-03-29 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with scrape type 2
2026-03-29 06:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb, identifier: YP74524
2026-03-29 06:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 06:35:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-29 06:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524 to the API
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'hybrid',
 'id': '87de171a-a0af-5ac6-8ec6-06d1f91ec5bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP74524',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 101969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-20',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-29 06:35:33 [auto1.be] INFO: Saving data for YP74524: {'auction_closing_time': 1774882837.0, 'created_time': 1774643921.33578, 'last_price_update_time': 1774766133.470925}
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YP74524') HTTP/1.1" 204 0
2026-03-29 06:35:33 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 06:35:33 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 06:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:33 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:33 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 06:35:33 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-29 06:35:33 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-29 06:35:33 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 06:35:33 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-29 06:35:33 [auto1.be] INFO: Scrape type for LK55982: 2
2026-03-29 06:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-29 06:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184efd05-1fb9-5849-b280-511811641ad9 with scrape type 2
2026-03-29 06:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184efd05-1fb9-5849-b280-511811641ad9 with scrape type 2
2026-03-29 06:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 184efd05-1fb9-5849-b280-511811641ad9, identifier: LK55982
2026-03-29 06:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-29 06:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-29 06:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982 to the API
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:17Z',
 'fuel_type': 'diesel',
 'id': '184efd05-1fb9-5849-b280-511811641ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK55982',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 138400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-05',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 30 L1H1 Business',
 'transmission': 'manual',
 'trim': '30 L1H1 Business',
 'year': 2018}
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-29 06:35:34 [auto1.be] INFO: Saving data for LK55982: {'auction_closing_time': 1774884137.0, 'created_time': 1774557326.626571, 'last_price_update_time': 1774766134.084757}
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK55982') HTTP/1.1" 204 0
2026-03-29 06:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:34 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-29 06:35:34 [auto1.be] INFO: Scrape type for DW77345: 2
2026-03-29 06:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-29 06:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66551045-57ae-5a77-b829-e167b3a9ebfb with scrape type 2
2026-03-29 06:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66551045-57ae-5a77-b829-e167b3a9ebfb with scrape type 2
2026-03-29 06:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66551045-57ae-5a77-b829-e167b3a9ebfb, identifier: DW77345
2026-03-29 06:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 06:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-29 06:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345 to the API
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:51:34Z',
 'fuel_type': 'diesel',
 'id': '66551045-57ae-5a77-b829-e167b3a9ebfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77345',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Terrano',
 'odometer': 133405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-28',
 'seller_name': None,
 'title': 'Nissan Terrano 3.0 TD Outdoor',
 'transmission': 'automatic',
 'trim': 'Outdoor',
 'year': 2006}
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-29 06:35:34 [auto1.be] INFO: Saving data for DW77345: {'auction_closing_time': 1774885894.0, 'created_time': 1774643745.435627, 'last_price_update_time': 1774766134.594171}
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW77345') HTTP/1.1" 204 0
2026-03-29 06:35:34 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-29 06:35:34 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-29 06:35:34 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 06:35:34 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 06:35:34 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 06:35:34 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-29 06:35:34 [auto1.be] INFO: Scrape type for AY47657: 2
2026-03-29 06:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-29 06:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with scrape type 2
2026-03-29 06:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with scrape type 2
2026-03-29 06:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb, identifier: AY47657
2026-03-29 06:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-29 06:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-29 06:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657 to the API
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'petrol',
 'id': 'c5c2b53d-f5e2-5f18-8ab6-cff861f912fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY47657',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 94952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-29 06:35:35 [auto1.be] INFO: Saving data for AY47657: {'auction_closing_time': 1774886135.0, 'created_time': 1773434531.165153, 'last_price_update_time': 1774766135.041818}
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY47657') HTTP/1.1" 204 0
2026-03-29 06:35:35 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-29 06:35:35 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-29 06:35:35 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 06:35:35 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-29 06:35:35 [auto1.be] INFO: Scrape type for AE13452: 2
2026-03-29 06:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-29 06:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310dcb03-133e-514f-86fb-8ea9a6203674 with scrape type 2
2026-03-29 06:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310dcb03-133e-514f-86fb-8ea9a6203674 with scrape type 2
2026-03-29 06:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 310dcb03-133e-514f-86fb-8ea9a6203674, identifier: AE13452
2026-03-29 06:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-29 06:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-29 06:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452 to the API
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:55Z',
 'fuel_type': 'petrol',
 'id': '310dcb03-133e-514f-86fb-8ea9a6203674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE13452',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 69362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-29 06:35:35 [auto1.be] INFO: Saving data for AE13452: {'auction_closing_time': 1774885375.0, 'created_time': 1773239795.139885, 'last_price_update_time': 1774766135.548814}
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE13452') HTTP/1.1" 204 0
2026-03-29 06:35:35 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-29 06:35:35 [auto1.be] INFO: Scrape type for FG26500: 2
2026-03-29 06:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-29 06:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with scrape type 2
2026-03-29 06:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with scrape type 2
2026-03-29 06:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c, identifier: FG26500
2026-03-29 06:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-29 06:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-29 06:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500 to the API
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:18Z',
 'fuel_type': 'petrol',
 'id': 'd03f3a5b-3a25-51c7-8dfc-224a0197bd7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG26500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 103179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-13',
 'seller_name': None,
 'title': 'Opel Insignia 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-29 06:35:35 [auto1.be] INFO: Saving data for FG26500: {'auction_closing_time': 1774885818.0, 'created_time': 1773834457.531177, 'last_price_update_time': 1774766135.982141}
2026-03-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG26500') HTTP/1.1" 204 0
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Scrape type for CK49467: 2
2026-03-29 06:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-29 06:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc0a755-e8d6-565a-ae23-49098886fea8 with scrape type 2
2026-03-29 06:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc0a755-e8d6-565a-ae23-49098886fea8 with scrape type 2
2026-03-29 06:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abc0a755-e8d6-565a-ae23-49098886fea8, identifier: CK49467
2026-03-29 06:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-29 06:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-29 06:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467 to the API
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:11Z',
 'fuel_type': 'diesel',
 'id': 'abc0a755-e8d6-565a-ae23-49098886fea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK49467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 84175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2015}
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Saving data for CK49467: {'auction_closing_time': 1774884431.0, 'created_time': 1773225621.316862, 'last_price_update_time': 1774766136.457594}
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK49467') HTTP/1.1" 204 0
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 06:35:36 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Scrape type for DL17322: 2
2026-03-29 06:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-29 06:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with scrape type 2
2026-03-29 06:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with scrape type 2
2026-03-29 06:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3, identifier: DL17322
2026-03-29 06:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-29 06:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-29 06:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322 to the API
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:47:21Z',
 'fuel_type': 'petrol',
 'id': '94a97b9e-79f0-5685-9957-e63f6c4dc0c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL17322',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-29 06:35:36 [auto1.be] INFO: Saving data for DL17322: {'auction_closing_time': 1774885641.0, 'created_time': 1774643944.604322, 'last_price_update_time': 1774766136.916317}
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL17322') HTTP/1.1" 204 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for XJ49438: 2
2026-03-29 06:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-29 06:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc460453-e314-5f70-916c-d01b8499e491 with scrape type 2
2026-03-29 06:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc460453-e314-5f70-916c-d01b8499e491 with scrape type 2
2026-03-29 06:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc460453-e314-5f70-916c-d01b8499e491, identifier: XJ49438
2026-03-29 06:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-29 06:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-29 06:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438 to the API
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:51:51Z',
 'fuel_type': 'petrol',
 'id': 'dc460453-e314-5f70-916c-d01b8499e491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ49438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'BMW 1er 116i Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2019}
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Saving data for XJ49438: {'auction_closing_time': 1774885911.0, 'created_time': 1773434128.408951, 'last_price_update_time': 1774766137.517755}
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ49438') HTTP/1.1" 204 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-29 06:35:37 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Scrape type for AB44644: 2
2026-03-29 06:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-29 06:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7720042d-1a73-513f-8346-94b4dbcccc53 with scrape type 2
2026-03-29 06:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7720042d-1a73-513f-8346-94b4dbcccc53 with scrape type 2
2026-03-29 06:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7720042d-1a73-513f-8346-94b4dbcccc53, identifier: AB44644
2026-03-29 06:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-29 06:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-29 06:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644 to the API
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:09Z',
 'fuel_type': 'petrol',
 'id': '7720042d-1a73-513f-8346-94b4dbcccc53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB44644',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 116152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2018}
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-29 06:35:37 [auto1.be] INFO: Saving data for AB44644: {'auction_closing_time': 1774885089.0, 'created_time': 1773834552.488357, 'last_price_update_time': 1774766137.975397}
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB44644') HTTP/1.1" 204 0
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 06:35:38 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Scrape type for RW94228: 2
2026-03-29 06:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-29 06:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with scrape type 2
2026-03-29 06:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with scrape type 2
2026-03-29 06:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 809dd09e-4224-5e52-aeff-e7f87afe2fd7, identifier: RW94228
2026-03-29 06:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-29 06:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-29 06:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228 to the API
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'petrol',
 'id': '809dd09e-4224-5e52-aeff-e7f87afe2fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW94228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-09',
 'seller_name': None,
 'title': 'BMW 3er 330i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Saving data for RW94228: {'auction_closing_time': 1774884516.0, 'created_time': 1773834432.483127, 'last_price_update_time': 1774766138.542692}
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW94228') HTTP/1.1" 204 0
2026-03-29 06:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Scrape type for FE52220: 2
2026-03-29 06:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-29 06:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dea1b79-b33b-5ea2-9059-2d7927825751 with scrape type 2
2026-03-29 06:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dea1b79-b33b-5ea2-9059-2d7927825751 with scrape type 2
2026-03-29 06:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1dea1b79-b33b-5ea2-9059-2d7927825751, identifier: FE52220
2026-03-29 06:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-29 06:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-29 06:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220 to the API
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:23Z',
 'fuel_type': 'petrol',
 'id': '1dea1b79-b33b-5ea2-9059-2d7927825751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE52220',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 140989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-29 06:35:38 [auto1.be] INFO: Saving data for FE52220: {'auction_closing_time': 1774885643.0, 'created_time': 1774643909.545391, 'last_price_update_time': 1774766138.971064}
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE52220') HTTP/1.1" 204 0
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 06:35:38 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-29 06:35:39 [auto1.be] INFO: Scrape type for YG62523: 2
2026-03-29 06:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-29 06:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997495a0-4c1f-5553-943c-a995e47ef1b5 with scrape type 2
2026-03-29 06:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 997495a0-4c1f-5553-943c-a995e47ef1b5 with scrape type 2
2026-03-29 06:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 997495a0-4c1f-5553-943c-a995e47ef1b5, identifier: YG62523
2026-03-29 06:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-29 06:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-29 06:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523 to the API
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:25:59Z',
 'fuel_type': 'diesel',
 'id': '997495a0-4c1f-5553-943c-a995e47ef1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG62523',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 240968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-29 06:35:39 [auto1.be] INFO: Saving data for YG62523: {'auction_closing_time': 1774884359.0, 'created_time': 1774643951.171657, 'last_price_update_time': 1774766139.366073}
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG62523') HTTP/1.1" 204 0
2026-03-29 06:35:39 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 06:35:39 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 06:35:39 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-29 06:35:39 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-29 06:35:39 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-29 06:35:39 [auto1.be] INFO: Scrape type for ZF47475: 2
2026-03-29 06:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-29 06:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf00e69-3619-56e2-a498-2a546291fd09 with scrape type 2
2026-03-29 06:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebf00e69-3619-56e2-a498-2a546291fd09 with scrape type 2
2026-03-29 06:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebf00e69-3619-56e2-a498-2a546291fd09, identifier: ZF47475
2026-03-29 06:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-29 06:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-29 06:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475 to the API
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:49:42Z',
 'fuel_type': 'diesel',
 'id': 'ebf00e69-3619-56e2-a498-2a546291fd09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF47475',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 181427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-29 06:35:39 [auto1.be] INFO: Saving data for ZF47475: {'auction_closing_time': 1774885782.0, 'created_time': 1774643786.561997, 'last_price_update_time': 1774766139.870273}
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF47475') HTTP/1.1" 204 0
2026-03-29 06:35:39 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-29 06:35:39 [auto1.be] INFO: Scrape type for XC82229: 2
2026-03-29 06:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-29 06:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702e2a30-4411-5c01-9d91-776d01caa249 with scrape type 2
2026-03-29 06:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 702e2a30-4411-5c01-9d91-776d01caa249 with scrape type 2
2026-03-29 06:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 702e2a30-4411-5c01-9d91-776d01caa249, identifier: XC82229
2026-03-29 06:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-29 06:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-29 06:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229 to the API
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:12Z',
 'fuel_type': 'diesel',
 'id': '702e2a30-4411-5c01-9d91-776d01caa249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC82229',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 107341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Saving data for XC82229: {'auction_closing_time': 1774882932.0, 'created_time': 1774643905.272469, 'last_price_update_time': 1774766140.305785}
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC82229') HTTP/1.1" 204 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for PN18532: 2
2026-03-29 06:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-29 06:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e81558-43ae-5478-9dee-39cbb0b045e4 with scrape type 2
2026-03-29 06:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e81558-43ae-5478-9dee-39cbb0b045e4 with scrape type 2
2026-03-29 06:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25e81558-43ae-5478-9dee-39cbb0b045e4, identifier: PN18532
2026-03-29 06:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-29 06:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-29 06:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532 to the API
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:35:22Z',
 'fuel_type': 'petrol',
 'id': '25e81558-43ae-5478-9dee-39cbb0b045e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN18532',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 100802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-18',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Saving data for PN18532: {'auction_closing_time': 1774884922.0, 'created_time': 1774643743.681616, 'last_price_update_time': 1774766140.7541}
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN18532') HTTP/1.1" 204 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-29 06:35:40 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-29 06:35:40 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 06:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:41 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:41 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 06:35:41 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for ZJ47299: 2
2026-03-29 06:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-29 06:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b03b22-9027-5a94-8b1f-e3d7022a458c with scrape type 2
2026-03-29 06:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8b03b22-9027-5a94-8b1f-e3d7022a458c with scrape type 2
2026-03-29 06:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b8b03b22-9027-5a94-8b1f-e3d7022a458c, identifier: ZJ47299
2026-03-29 06:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-29 06:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-29 06:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299 to the API
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'petrol',
 'id': 'b8b03b22-9027-5a94-8b1f-e3d7022a458c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ47299',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 113081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-11',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 MIVEC Invite 2WD',
 'transmission': 'manual',
 'trim': 'Invite 2WD',
 'year': 2015}
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Saving data for ZJ47299: {'auction_closing_time': 1774885702.0, 'created_time': 1774644008.509825, 'last_price_update_time': 1774766142.469159}
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ47299') HTTP/1.1" 204 0
2026-03-29 06:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-29 06:35:42 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-29 06:35:42 [auto1.be] INFO: Scrape type for HA88594: 2
2026-03-29 06:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-29 06:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e262515-9741-5b52-9626-5ac56dd9ee03 with scrape type 2
2026-03-29 06:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e262515-9741-5b52-9626-5ac56dd9ee03 with scrape type 2
2026-03-29 06:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e262515-9741-5b52-9626-5ac56dd9ee03, identifier: HA88594
2026-03-29 06:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 06:35:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-29 06:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594 to the API
2026-03-29 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'hybrid',
 'id': '2e262515-9741-5b52-9626-5ac56dd9ee03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88594',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 37987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-29 06:35:43 [auto1.be] INFO: Saving data for HA88594: {'auction_closing_time': 1774883052.0, 'created_time': 1774557427.949412, 'last_price_update_time': 1774766143.164368}
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HA88594') HTTP/1.1" 204 0
2026-03-29 06:35:43 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 06:35:43 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-29 06:35:43 [auto1.be] INFO: Scrape type for JZ16543: 2
2026-03-29 06:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-29 06:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0873f4e9-2bac-5146-829e-773bd08d7257 with scrape type 2
2026-03-29 06:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0873f4e9-2bac-5146-829e-773bd08d7257 with scrape type 2
2026-03-29 06:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0873f4e9-2bac-5146-829e-773bd08d7257, identifier: JZ16543
2026-03-29 06:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-29 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-29 06:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543 to the API
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'diesel',
 'id': '0873f4e9-2bac-5146-829e-773bd08d7257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ16543',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 235945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-29 06:35:43 [auto1.be] INFO: Saving data for JZ16543: {'auction_closing_time': 1774883872.0, 'created_time': 1774643969.23016, 'last_price_update_time': 1774766143.558437}
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ16543') HTTP/1.1" 204 0
2026-03-29 06:35:43 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-29 06:35:43 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-29 06:35:43 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-29 06:35:43 [auto1.be] INFO: Scrape type for NP17382: 2
2026-03-29 06:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-29 06:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with scrape type 2
2026-03-29 06:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with scrape type 2
2026-03-29 06:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6, identifier: NP17382
2026-03-29 06:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 06:35:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-29 06:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382 to the API
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:08:40Z',
 'fuel_type': 'petrol',
 'id': '2c202a75-ed5a-5c64-a1ad-7def648fb7e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP17382',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 17561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-29 06:35:44 [auto1.be] INFO: Saving data for NP17382: {'auction_closing_time': 1774883320.0, 'created_time': 1774643915.565849, 'last_price_update_time': 1774766144.124367}
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP17382') HTTP/1.1" 204 0
2026-03-29 06:35:44 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 06:35:44 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 06:35:44 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 06:35:44 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-29 06:35:44 [auto1.be] INFO: Scrape type for TE72836: 2
2026-03-29 06:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-29 06:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24efa657-a08a-50ea-80cc-535f3b4eac61 with scrape type 2
2026-03-29 06:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24efa657-a08a-50ea-80cc-535f3b4eac61 with scrape type 2
2026-03-29 06:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24efa657-a08a-50ea-80cc-535f3b4eac61, identifier: TE72836
2026-03-29 06:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 06:35:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-29 06:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836 to the API
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:38Z',
 'fuel_type': 'diesel',
 'id': '24efa657-a08a-50ea-80cc-535f3b4eac61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE72836',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-29 06:35:44 [auto1.be] INFO: Saving data for TE72836: {'auction_closing_time': 1774885478.0, 'created_time': 1774643747.114791, 'last_price_update_time': 1774766144.725415}
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE72836') HTTP/1.1" 204 0
2026-03-29 06:35:44 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 06:35:44 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-29 06:35:44 [auto1.be] INFO: Scrape type for SS18683: 2
2026-03-29 06:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-29 06:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3df223-d8e8-5ca7-b738-87c3dc67237a with scrape type 2
2026-03-29 06:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f3df223-d8e8-5ca7-b738-87c3dc67237a with scrape type 2
2026-03-29 06:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f3df223-d8e8-5ca7-b738-87c3dc67237a, identifier: SS18683
2026-03-29 06:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-29 06:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-29 06:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683 to the API
2026-03-29 06:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:00Z',
 'fuel_type': 'diesel',
 'id': '1f3df223-d8e8-5ca7-b738-87c3dc67237a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS18683',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 117236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2016}
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-29 06:35:45 [auto1.be] INFO: Saving data for SS18683: {'auction_closing_time': 1774885980.0, 'created_time': 1773434504.189128, 'last_price_update_time': 1774766145.124778}
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SS18683') HTTP/1.1" 204 0
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-29 06:35:45 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-29 06:35:45 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-29 06:35:45 [auto1.be] INFO: Scrape type for XK75143: 2
2026-03-29 06:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-29 06:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with scrape type 2
2026-03-29 06:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with scrape type 2
2026-03-29 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388, identifier: XK75143
2026-03-29 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-29 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-29 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143 to the API
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'diesel',
 'id': '832bc6d3-5079-526e-a8b2-7c0cf7ea5388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK75143',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 56193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Express Maxi',
 'transmission': 'manual',
 'trim': 'Express Maxi',
 'year': 2019}
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-29 06:35:45 [auto1.be] INFO: Saving data for XK75143: {'auction_closing_time': 1774884476.0, 'created_time': 1774557325.150018, 'last_price_update_time': 1774766145.57759}
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK75143') HTTP/1.1" 204 0
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 06:35:45 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-29 06:35:45 [auto1.be] INFO: Scrape type for ZH69808: 2
2026-03-29 06:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-29 06:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cf23860-d8c1-57eb-835e-c370a2654844 with scrape type 2
2026-03-29 06:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cf23860-d8c1-57eb-835e-c370a2654844 with scrape type 2
2026-03-29 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4cf23860-d8c1-57eb-835e-c370a2654844, identifier: ZH69808
2026-03-29 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-29 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-29 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808 to the API
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:30Z',
 'fuel_type': 'petrol',
 'id': '4cf23860-d8c1-57eb-835e-c370a2654844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH69808',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 87875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-29 06:35:46 [auto1.be] INFO: Saving data for ZH69808: {'auction_closing_time': 1774886370.0, 'created_time': 1774557332.681902, 'last_price_update_time': 1774766146.000069}
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH69808') HTTP/1.1" 204 0
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-29 06:35:46 [auto1.be] INFO: Scrape type for DY96127: 2
2026-03-29 06:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-29 06:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with scrape type 2
2026-03-29 06:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with scrape type 2
2026-03-29 06:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e, identifier: DY96127
2026-03-29 06:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-29 06:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-29 06:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127 to the API
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'petrol',
 'id': 'f0ab4ea5-3f2b-5460-bfa1-5d501721e97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY96127',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 265005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-20',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-29 06:35:46 [auto1.be] INFO: Saving data for DY96127: {'auction_closing_time': 1774884220.0, 'created_time': 1774643956.898777, 'last_price_update_time': 1774766146.495581}
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY96127') HTTP/1.1" 204 0
2026-03-29 06:35:46 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-29 06:35:46 [auto1.be] INFO: Scrape type for HT10085: 2
2026-03-29 06:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-29 06:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 with scrape type 2
2026-03-29 06:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 with scrape type 2
2026-03-29 06:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93ffbcec-e498-5381-a1c2-87246a33d0b6, identifier: HT10085
2026-03-29 06:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 06:35:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-29 06:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085 to the API
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:06:16Z',
 'fuel_type': 'petrol',
 'id': '93ffbcec-e498-5381-a1c2-87246a33d0b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT10085',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 207199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Saving data for HT10085: {'auction_closing_time': 1774883176.0, 'created_time': 1774643943.914207, 'last_price_update_time': 1774766147.06454}
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT10085') HTTP/1.1" 204 0
2026-03-29 06:35:47 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-29 06:35:47 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Scrape type for DP96261: 2
2026-03-29 06:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-29 06:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9e1707-ded2-5554-ba55-00530f25d636 with scrape type 2
2026-03-29 06:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9e1707-ded2-5554-ba55-00530f25d636 with scrape type 2
2026-03-29 06:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a9e1707-ded2-5554-ba55-00530f25d636, identifier: DP96261
2026-03-29 06:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-29 06:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-29 06:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261 to the API
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:28:50Z',
 'fuel_type': 'petrol',
 'id': '2a9e1707-ded2-5554-ba55-00530f25d636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP96261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 42409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Saving data for DP96261: {'auction_closing_time': 1774884530.0, 'created_time': 1773909329.691701, 'last_price_update_time': 1774766147.508819}
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP96261') HTTP/1.1" 204 0
2026-03-29 06:35:47 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-29 06:35:47 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:47 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 06:35:47 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Scrape type for MD04738: 2
2026-03-29 06:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-29 06:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fb81f7-38f0-5f29-acdd-c733dca943cc with scrape type 2
2026-03-29 06:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0fb81f7-38f0-5f29-acdd-c733dca943cc with scrape type 2
2026-03-29 06:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0fb81f7-38f0-5f29-acdd-c733dca943cc, identifier: MD04738
2026-03-29 06:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-29 06:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-29 06:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738 to the API
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'petrol',
 'id': 'c0fb81f7-38f0-5f29-acdd-c733dca943cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD04738',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-29 06:35:47 [auto1.be] INFO: Saving data for MD04738: {'auction_closing_time': 1774885433.0, 'created_time': 1773650180.943265, 'last_price_update_time': 1774766147.943228}
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD04738') HTTP/1.1" 204 0
2026-03-29 06:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for NW54949: 2
2026-03-29 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-29 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff1ab37-6112-5b13-a202-a694b65a0e9c with scrape type 2
2026-03-29 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff1ab37-6112-5b13-a202-a694b65a0e9c with scrape type 2
2026-03-29 06:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ff1ab37-6112-5b13-a202-a694b65a0e9c, identifier: NW54949
2026-03-29 06:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-29 06:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-29 06:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949 to the API
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:27Z',
 'fuel_type': 'diesel',
 'id': '5ff1ab37-6112-5b13-a202-a694b65a0e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW54949',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 117371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-03',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Saving data for NW54949: {'auction_closing_time': 1774884507.0, 'created_time': 1774643935.343815, 'last_price_update_time': 1774766148.43958}
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NW54949') HTTP/1.1" 204 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for CW40114: 2
2026-03-29 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-29 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with scrape type 2
2026-03-29 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with scrape type 2
2026-03-29 06:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae, identifier: CW40114
2026-03-29 06:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-29 06:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-29 06:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114 to the API
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:34Z',
 'fuel_type': 'petrol',
 'id': '6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW40114',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 153710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Saving data for CW40114: {'auction_closing_time': 1774886134.0, 'created_time': 1773434141.608684, 'last_price_update_time': 1774766148.83864}
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW40114') HTTP/1.1" 204 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 06:35:48 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-29 06:35:48 [auto1.be] INFO: Scrape type for HP74170: 2
2026-03-29 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-29 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 with scrape type 2
2026-03-29 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 with scrape type 2
2026-03-29 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58d190d7-ae2b-59be-b179-cfe65922cfe0, identifier: HP74170
2026-03-29 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-29 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-29 06:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170 to the API
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:29:18Z',
 'fuel_type': 'diesel',
 'id': '58d190d7-ae2b-59be-b179-cfe65922cfe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP74170',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 151930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-29 06:35:49 [auto1.be] INFO: Saving data for HP74170: {'auction_closing_time': 1774884558.0, 'created_time': 1774643991.307399, 'last_price_update_time': 1774766149.346242}
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP74170') HTTP/1.1" 204 0
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-29 06:35:49 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-29 06:35:49 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-29 06:35:49 [auto1.be] INFO: Scrape type for HX42019: 2
2026-03-29 06:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-29 06:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with scrape type 2
2026-03-29 06:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with scrape type 2
2026-03-29 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47, identifier: HX42019
2026-03-29 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-29 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-29 06:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019 to the API
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'petrol',
 'id': '7805f9c5-0726-5cdf-9ffa-e191aefa6f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX42019',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 16623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-27',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2024}
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-29 06:35:49 [auto1.be] INFO: Saving data for HX42019: {'auction_closing_time': 1774884351.0, 'created_time': 1774643857.9698, 'last_price_update_time': 1774766149.885037}
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX42019') HTTP/1.1" 204 0
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 06:35:49 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-29 06:35:49 [auto1.be] INFO: Scrape type for SV05686: 2
2026-03-29 06:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-29 06:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with scrape type 2
2026-03-29 06:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with scrape type 2
2026-03-29 06:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f, identifier: SV05686
2026-03-29 06:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-29 06:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-29 06:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686 to the API
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:52:10Z',
 'fuel_type': 'diesel',
 'id': '3a7e7a30-1a97-5eda-99e4-49a3405a0d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV05686',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 206571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-29 06:35:50 [auto1.be] INFO: Saving data for SV05686: {'auction_closing_time': 1774885930.0, 'created_time': 1774557355.409705, 'last_price_update_time': 1774766150.330511}
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV05686') HTTP/1.1" 204 0
2026-03-29 06:35:50 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 06:35:50 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 06:35:50 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-29 06:35:50 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-29 06:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:51 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Scrape type for JJ27182: 2
2026-03-29 06:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-29 06:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with scrape type 2
2026-03-29 06:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with scrape type 2
2026-03-29 06:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3, identifier: JJ27182
2026-03-29 06:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-29 06:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-29 06:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182 to the API
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:35:15Z',
 'fuel_type': 'diesel',
 'id': '1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ27182',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 238550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2012}
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Saving data for JJ27182: {'auction_closing_time': 1774884915.0, 'created_time': 1774644016.994636, 'last_price_update_time': 1774766151.487354}
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ27182') HTTP/1.1" 204 0
2026-03-29 06:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-29 06:35:51 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Scrape type for CD53749: 2
2026-03-29 06:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-29 06:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340357b4-4fa8-5a28-b374-517e6f18c66f with scrape type 2
2026-03-29 06:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340357b4-4fa8-5a28-b374-517e6f18c66f with scrape type 2
2026-03-29 06:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 340357b4-4fa8-5a28-b374-517e6f18c66f, identifier: CD53749
2026-03-29 06:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-29 06:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-29 06:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749 to the API
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:53Z',
 'fuel_type': 'diesel',
 'id': '340357b4-4fa8-5a28-b374-517e6f18c66f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD53749',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 269576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-02',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-29 06:35:51 [auto1.be] INFO: Saving data for CD53749: {'auction_closing_time': 1774884893.0, 'created_time': 1773909331.016785, 'last_price_update_time': 1774766151.990798}
2026-03-29 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD53749') HTTP/1.1" 204 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for KV01738: 2
2026-03-29 06:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-29 06:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b819f3-ff35-5688-95c2-36f44ab7e59e with scrape type 2
2026-03-29 06:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b819f3-ff35-5688-95c2-36f44ab7e59e with scrape type 2
2026-03-29 06:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70b819f3-ff35-5688-95c2-36f44ab7e59e, identifier: KV01738
2026-03-29 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-29 06:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-29 06:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738 to the API
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'petrol',
 'id': '70b819f3-ff35-5688-95c2-36f44ab7e59e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV01738',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 216617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Soleil',
 'transmission': 'manual',
 'trim': 'Soleil',
 'year': 2019}
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Saving data for KV01738: {'auction_closing_time': 1774885312.0, 'created_time': 1774643832.341837, 'last_price_update_time': 1774766152.488691}
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV01738') HTTP/1.1" 204 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 06:35:52 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-29 06:35:52 [auto1.be] INFO: Scrape type for UW52037: 2
2026-03-29 06:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-29 06:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 540272db-9b64-5856-bc7b-f4976cdce59c with scrape type 2
2026-03-29 06:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 540272db-9b64-5856-bc7b-f4976cdce59c with scrape type 2
2026-03-29 06:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 540272db-9b64-5856-bc7b-f4976cdce59c, identifier: UW52037
2026-03-29 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-29 06:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-29 06:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037 to the API
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'diesel',
 'id': '540272db-9b64-5856-bc7b-f4976cdce59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW52037',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 199524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D3 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2020}
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Saving data for UW52037: {'auction_closing_time': 1774883382.0, 'created_time': 1774643955.692586, 'last_price_update_time': 1774766153.03177}
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW52037') HTTP/1.1" 204 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for RY14212: 2
2026-03-29 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-29 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 292d0c5d-e39e-5805-8c93-a44125c26007 with scrape type 2
2026-03-29 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 292d0c5d-e39e-5805-8c93-a44125c26007 with scrape type 2
2026-03-29 06:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 292d0c5d-e39e-5805-8c93-a44125c26007, identifier: RY14212
2026-03-29 06:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-29 06:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-29 06:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212 to the API
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'petrol',
 'id': '292d0c5d-e39e-5805-8c93-a44125c26007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY14212',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 215442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2016}
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Saving data for RY14212: {'auction_closing_time': 1774885507.0, 'created_time': 1773909358.160747, 'last_price_update_time': 1774766153.483682}
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY14212') HTTP/1.1" 204 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for EL33380: 2
2026-03-29 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-29 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9750c431-3c7c-5715-be03-3746c097c497 with scrape type 2
2026-03-29 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9750c431-3c7c-5715-be03-3746c097c497 with scrape type 2
2026-03-29 06:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9750c431-3c7c-5715-be03-3746c097c497, identifier: EL33380
2026-03-29 06:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-29 06:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-29 06:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380 to the API
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'diesel',
 'id': '9750c431-3c7c-5715-be03-3746c097c497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL33380',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 244350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2013}
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Saving data for EL33380: {'auction_closing_time': 1774883655.0, 'created_time': 1774557425.860054, 'last_price_update_time': 1774766153.911815}
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL33380') HTTP/1.1" 204 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-29 06:35:53 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-29 06:35:53 [auto1.be] INFO: Scrape type for YK73361: 2
2026-03-29 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-29 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with scrape type 2
2026-03-29 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with scrape type 2
2026-03-29 06:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66f0530b-7bb4-5c75-b619-81fb5fd46d51, identifier: YK73361
2026-03-29 06:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-29 06:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-29 06:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361 to the API
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:09:06Z',
 'fuel_type': 'diesel',
 'id': '66f0530b-7bb4-5c75-b619-81fb5fd46d51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK73361',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 141793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-29 06:35:54 [auto1.be] INFO: Saving data for YK73361: {'auction_closing_time': 1774883346.0, 'created_time': 1774557324.647236, 'last_price_update_time': 1774766154.351011}
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK73361') HTTP/1.1" 204 0
2026-03-29 06:35:54 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-29 06:35:54 [auto1.be] INFO: Scrape type for FF99790: 2
2026-03-29 06:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-29 06:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc4450d-a9da-53ea-b379-ffb0596c3043 with scrape type 2
2026-03-29 06:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc4450d-a9da-53ea-b379-ffb0596c3043 with scrape type 2
2026-03-29 06:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fc4450d-a9da-53ea-b379-ffb0596c3043, identifier: FF99790
2026-03-29 06:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-29 06:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-29 06:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790 to the API
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:56:39Z',
 'fuel_type': 'petrol',
 'id': '6fc4450d-a9da-53ea-b379-ffb0596c3043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF99790',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 112770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-29 06:35:54 [auto1.be] INFO: Saving data for FF99790: {'auction_closing_time': 1774886199.0, 'created_time': 1774557417.582953, 'last_price_update_time': 1774766154.857966}
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF99790') HTTP/1.1" 204 0
2026-03-29 06:35:54 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-29 06:35:54 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-29 06:35:54 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 06:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:55 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:55 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 06:35:55 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-29 06:35:55 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-29 06:35:55 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 06:35:55 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 06:35:55 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-29 06:35:55 [auto1.be] INFO: Scrape type for CU87114: 2
2026-03-29 06:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-29 06:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with scrape type 2
2026-03-29 06:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with scrape type 2
2026-03-29 06:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050, identifier: CU87114
2026-03-29 06:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-29 06:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-29 06:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114 to the API
2026-03-29 06:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:09Z',
 'fuel_type': 'petrol',
 'id': '75dcc80f-8bf9-5b99-a0ef-027f97a8b050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU87114',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 17473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2021}
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Saving data for CU87114: {'auction_closing_time': 1774883289.0, 'created_time': 1773520652.9053, 'last_price_update_time': 1774766156.102949}
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU87114') HTTP/1.1" 204 0
2026-03-29 06:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Scrape type for BV41613: 2
2026-03-29 06:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-29 06:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with scrape type 2
2026-03-29 06:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with scrape type 2
2026-03-29 06:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78, identifier: BV41613
2026-03-29 06:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-29 06:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-29 06:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613 to the API
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:53Z',
 'fuel_type': 'diesel',
 'id': '887d96fd-a4ef-5610-a527-9ed2c3b6ff78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV41613',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 229780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-07',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Saving data for BV41613: {'auction_closing_time': 1774885553.0, 'created_time': 1774644015.360964, 'last_price_update_time': 1774766156.508457}
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV41613') HTTP/1.1" 204 0
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 06:35:56 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-29 06:35:56 [auto1.be] INFO: Scrape type for PJ20685: 2
2026-03-29 06:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-29 06:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with scrape type 2
2026-03-29 06:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with scrape type 2
2026-03-29 06:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a34909d-0f97-58e7-afcb-02caf3ffeb80, identifier: PJ20685
2026-03-29 06:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-29 06:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-29 06:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685 to the API
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:48:51Z',
 'fuel_type': 'petrol',
 'id': '0a34909d-0f97-58e7-afcb-02caf3ffeb80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ20685',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 43724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-03-29 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Saving data for PJ20685: {'auction_closing_time': 1774885731.0, 'created_time': 1773239954.362352, 'last_price_update_time': 1774766157.001228}
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ20685') HTTP/1.1" 204 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for CV26650: 2
2026-03-29 06:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-29 06:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with scrape type 2
2026-03-29 06:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with scrape type 2
2026-03-29 06:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d, identifier: CV26650
2026-03-29 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-29 06:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650 to the API
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:21:49Z',
 'fuel_type': 'petrol',
 'id': '053ddd54-7cb9-5f6c-9a40-f0f2df12153d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV26650',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 123722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-03',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Saving data for CV26650: {'auction_closing_time': 1774884109.0, 'created_time': 1774557460.89487, 'last_price_update_time': 1774766157.709915}
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV26650') HTTP/1.1" 204 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-29 06:35:57 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-29 06:35:57 [auto1.be] INFO: Scrape type for RU10603: 2
2026-03-29 06:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-29 06:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8508898-f2f2-5c2f-af7f-49a19194831b with scrape type 2
2026-03-29 06:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8508898-f2f2-5c2f-af7f-49a19194831b with scrape type 2
2026-03-29 06:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8508898-f2f2-5c2f-af7f-49a19194831b, identifier: RU10603
2026-03-29 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-29 06:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-29 06:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603 to the API
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:32Z',
 'fuel_type': 'diesel',
 'id': 'e8508898-f2f2-5c2f-af7f-49a19194831b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU10603',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 111369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2017}
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-29 06:35:58 [auto1.be] INFO: Saving data for RU10603: {'auction_closing_time': 1774886192.0, 'created_time': 1774643911.13316, 'last_price_update_time': 1774766158.293847}
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU10603') HTTP/1.1" 204 0
2026-03-29 06:35:58 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 06:35:58 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 06:35:58 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-29 06:35:58 [auto1.be] INFO: Scrape type for KW80684: 2
2026-03-29 06:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-29 06:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with scrape type 2
2026-03-29 06:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with scrape type 2
2026-03-29 06:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9, identifier: KW80684
2026-03-29 06:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-29 06:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-29 06:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684 to the API
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:54Z',
 'fuel_type': 'diesel',
 'id': '13bd6a3b-311f-5798-9dfb-de19fc97f8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW80684',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'FR-V',
 'odometer': 202431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-11',
 'seller_name': None,
 'title': 'Honda FR-V 2.2 CTDI CTDi Comfort',
 'transmission': 'manual',
 'trim': 'CTDi Comfort',
 'year': 2006}
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-29 06:35:58 [auto1.be] INFO: Saving data for KW80684: {'auction_closing_time': 1774883514.0, 'created_time': 1774557323.389532, 'last_price_update_time': 1774766158.697519}
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW80684') HTTP/1.1" 204 0
2026-03-29 06:35:58 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-29 06:35:58 [auto1.be] INFO: Scrape type for LF90651: 2
2026-03-29 06:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-29 06:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bbf32d6-3e0d-599b-a271-8b7b1595182f with scrape type 2
2026-03-29 06:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bbf32d6-3e0d-599b-a271-8b7b1595182f with scrape type 2
2026-03-29 06:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bbf32d6-3e0d-599b-a271-8b7b1595182f, identifier: LF90651
2026-03-29 06:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-29 06:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-29 06:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651 to the API
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:14:58Z',
 'fuel_type': 'petrol',
 'id': '1bbf32d6-3e0d-599b-a271-8b7b1595182f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF90651',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Courier',
 'odometer': 4418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Ford Transit Courier 1.0 EcoBoost Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-29 06:35:59 [auto1.be] INFO: Saving data for LF90651: {'auction_closing_time': 1774883698.0, 'created_time': 1773953495.093067, 'last_price_update_time': 1774766159.218371}
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF90651') HTTP/1.1" 204 0
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 06:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:35:59 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1093 | hits on page: 40
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-29 06:35:59 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-29 06:35:59 [auto1.be] INFO: Scrape type for BV36868: 2
2026-03-29 06:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-29 06:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3744e4b7-4e40-5aa2-86da-4e72845af362 with scrape type 2
2026-03-29 06:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3744e4b7-4e40-5aa2-86da-4e72845af362 with scrape type 2
2026-03-29 06:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3744e4b7-4e40-5aa2-86da-4e72845af362, identifier: BV36868
2026-03-29 06:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-29 06:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-29 06:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868 to the API
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:20:01Z',
 'fuel_type': 'diesel',
 'id': '3744e4b7-4e40-5aa2-86da-4e72845af362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV36868',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2022}
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-29 06:35:59 [auto1.be] INFO: Saving data for BV36868: {'auction_closing_time': 1774884001.0, 'created_time': 1774557585.881787, 'last_price_update_time': 1774766159.798024}
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV36868') HTTP/1.1" 204 0
2026-03-29 06:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-29 06:35:59 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 06:35:59 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-29 06:35:59 [auto1.be] INFO: Scrape type for RM32931: 2
2026-03-29 06:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-29 06:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with scrape type 2
2026-03-29 06:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with scrape type 2
2026-03-29 06:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f, identifier: RM32931
2026-03-29 06:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-29 06:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-29 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931 to the API
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:52:07Z',
 'fuel_type': 'diesel',
 'id': '3c39c42e-0bc5-53aa-bda9-b92d0c77374f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM32931',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Navara Pick-up',
 'odometer': 89671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Nissan Navara Pick-up 3.0 V6 dCi Double Cab LE 4x4',
 'transmission': 'automatic',
 'trim': 'Double Cab LE 4x4',
 'year': 2016}
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-29 06:36:00 [auto1.be] INFO: Saving data for RM32931: {'auction_closing_time': 1774885927.0, 'created_time': 1774643908.183247, 'last_price_update_time': 1774766160.247859}
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM32931') HTTP/1.1" 204 0
2026-03-29 06:36:00 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-29 06:36:00 [auto1.be] INFO: Scrape type for SK81997: 2
2026-03-29 06:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-29 06:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with scrape type 2
2026-03-29 06:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with scrape type 2
2026-03-29 06:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56177e08-6d3d-5481-9f0b-adbc9eeaede2, identifier: SK81997
2026-03-29 06:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-29 06:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-29 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997 to the API
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'diesel',
 'id': '56177e08-6d3d-5481-9f0b-adbc9eeaede2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK81997',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 169952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D3 Linje Svart',
 'transmission': 'manual',
 'trim': 'Linje Svart',
 'year': 2018}
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-29 06:36:00 [auto1.be] INFO: Saving data for SK81997: {'auction_closing_time': 1774884877.0, 'created_time': 1773909335.342104, 'last_price_update_time': 1774766160.670011}
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK81997') HTTP/1.1" 204 0
2026-03-29 06:36:00 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 06:36:00 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-29 06:36:00 [auto1.be] INFO: Scrape type for PJ31589: 2
2026-03-29 06:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-29 06:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with scrape type 2
2026-03-29 06:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with scrape type 2
2026-03-29 06:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb, identifier: PJ31589
2026-03-29 06:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-29 06:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-29 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589 to the API
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'diesel',
 'id': '6f7d4129-2e6e-51ba-ab9d-98e84cffadfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ31589',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 130985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.7 BLUE dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Saving data for PJ31589: {'auction_closing_time': 1774884424.0, 'created_time': 1774557420.949152, 'last_price_update_time': 1774766161.088959}
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ31589') HTTP/1.1" 204 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for UF59925: 2
2026-03-29 06:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-29 06:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb397cae-cd70-5757-9a4a-4f90035e4674 with scrape type 2
2026-03-29 06:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb397cae-cd70-5757-9a4a-4f90035e4674 with scrape type 2
2026-03-29 06:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb397cae-cd70-5757-9a4a-4f90035e4674, identifier: UF59925
2026-03-29 06:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-29 06:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-29 06:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925 to the API
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:04:04Z',
 'fuel_type': 'diesel',
 'id': 'bb397cae-cd70-5757-9a4a-4f90035e4674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF59925',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 120472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Saving data for UF59925: {'auction_closing_time': 1774883044.0, 'created_time': 1774643999.091058, 'last_price_update_time': 1774766161.577732}
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF59925') HTTP/1.1" 204 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 06:36:01 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-29 06:36:01 [auto1.be] INFO: Scrape type for BC32945: 2
2026-03-29 06:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-29 06:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e536945-6c61-5a8b-b098-29e70071a9f5 with scrape type 2
2026-03-29 06:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e536945-6c61-5a8b-b098-29e70071a9f5 with scrape type 2
2026-03-29 06:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e536945-6c61-5a8b-b098-29e70071a9f5, identifier: BC32945
2026-03-29 06:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-29 06:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-29 06:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945 to the API
2026-03-29 06:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 350,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'petrol',
 'id': '0e536945-6c61-5a8b-b098-29e70071a9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC32945',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 110020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 TwinTurbo Gran Lusso Q4',
 'transmission': 'automatic',
 'trim': 'Gran Lusso Q4',
 'year': 2019}
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-29 06:36:02 [auto1.be] INFO: Saving data for BC32945: {'auction_closing_time': 1774885320.0, 'created_time': 1774643823.52297, 'last_price_update_time': 1774766162.175843}
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC32945') HTTP/1.1" 204 0
2026-03-29 06:36:02 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-29 06:36:02 [auto1.be] INFO: Scrape type for NB71425: 2
2026-03-29 06:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-29 06:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a057a9dc-fb8e-5001-997b-63384be95c51 with scrape type 2
2026-03-29 06:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a057a9dc-fb8e-5001-997b-63384be95c51 with scrape type 2
2026-03-29 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a057a9dc-fb8e-5001-997b-63384be95c51, identifier: NB71425
2026-03-29 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-29 06:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-29 06:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425 to the API
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:45Z',
 'fuel_type': 'diesel',
 'id': 'a057a9dc-fb8e-5001-997b-63384be95c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB71425',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 107273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-29 06:36:02 [auto1.be] INFO: Saving data for NB71425: {'auction_closing_time': 1774885905.0, 'created_time': 1773240638.008076, 'last_price_update_time': 1774766162.716758}
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB71425') HTTP/1.1" 204 0
2026-03-29 06:36:02 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-29 06:36:02 [auto1.be] INFO: Scrape type for HJ67440: 2
2026-03-29 06:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-29 06:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22cd2476-acf9-5223-8aac-b88702901fdc with scrape type 2
2026-03-29 06:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22cd2476-acf9-5223-8aac-b88702901fdc with scrape type 2
2026-03-29 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22cd2476-acf9-5223-8aac-b88702901fdc, identifier: HJ67440
2026-03-29 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-29 06:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-29 06:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440 to the API
2026-03-29 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:44:39Z',
 'fuel_type': 'diesel',
 'id': '22cd2476-acf9-5223-8aac-b88702901fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ67440',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 157735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport D250 Mild-Hybrid HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2021}
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-29 06:36:03 [auto1.be] INFO: Saving data for HJ67440: {'auction_closing_time': 1774885479.0, 'created_time': 1774557327.728909, 'last_price_update_time': 1774766163.125816}
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ67440') HTTP/1.1" 204 0
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-29 06:36:03 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-29 06:36:03 [auto1.be] INFO: Scrape type for PN62826: 2
2026-03-29 06:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-29 06:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with scrape type 2
2026-03-29 06:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with scrape type 2
2026-03-29 06:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc, identifier: PN62826
2026-03-29 06:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-29 06:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-29 06:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826 to the API
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:08:18Z',
 'fuel_type': 'diesel',
 'id': '2f7bdd03-0d22-594a-99ea-d3e40a3907dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN62826',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 437968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
 'transmission': 'manual',
 'trim': 'T Avantgarde',
 'year': 2007}
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-29 06:36:03 [auto1.be] INFO: Saving data for PN62826: {'auction_closing_time': 1774883298.0, 'created_time': 1773693391.897711, 'last_price_update_time': 1774766163.538957}
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN62826') HTTP/1.1" 204 0
2026-03-29 06:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-29 06:36:03 [auto1.be] INFO: Scrape type for EF70909: 2
2026-03-29 06:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-29 06:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89689ae0-27af-5545-bbd7-6643c93415f9 with scrape type 2
2026-03-29 06:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89689ae0-27af-5545-bbd7-6643c93415f9 with scrape type 2
2026-03-29 06:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89689ae0-27af-5545-bbd7-6643c93415f9, identifier: EF70909
2026-03-29 06:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-29 06:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-29 06:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909 to the API
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:28Z',
 'fuel_type': 'petrol',
 'id': '89689ae0-27af-5545-bbd7-6643c93415f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF70909',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 93238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-29 06:36:03 [auto1.be] INFO: Saving data for EF70909: {'auction_closing_time': 1774885768.0, 'created_time': 1773909340.992138, 'last_price_update_time': 1774766163.96158}
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EF70909') HTTP/1.1" 204 0
2026-03-29 06:36:03 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 06:36:03 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for NK56969: 2
2026-03-29 06:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-29 06:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b69580-4a85-5b00-afa1-c61fd457ef90 with scrape type 2
2026-03-29 06:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b69580-4a85-5b00-afa1-c61fd457ef90 with scrape type 2
2026-03-29 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 57b69580-4a85-5b00-afa1-c61fd457ef90, identifier: NK56969
2026-03-29 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-29 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-29 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969 to the API
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:38Z',
 'fuel_type': 'petrol',
 'id': '57b69580-4a85-5b00-afa1-c61fd457ef90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK56969',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 73009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Saving data for NK56969: {'auction_closing_time': 1774886258.0, 'created_time': 1773240401.028257, 'last_price_update_time': 1774766164.589161}
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK56969') HTTP/1.1" 204 0
2026-03-29 06:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:04 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-29 06:36:04 [auto1.be] INFO: Scrape type for MT09894: 2
2026-03-29 06:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-29 06:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with scrape type 2
2026-03-29 06:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with scrape type 2
2026-03-29 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09e36a63-89b1-5ad1-a527-9d17f6ca5750, identifier: MT09894
2026-03-29 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-29 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-29 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894 to the API
2026-03-29 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:20Z',
 'fuel_type': 'petrol',
 'id': '09e36a63-89b1-5ad1-a527-9d17f6ca5750',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT09894',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 71076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 Turbo Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2016}
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Saving data for MT09894: {'auction_closing_time': 1774885820.0, 'created_time': 1774643796.670155, 'last_price_update_time': 1774766165.111777}
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MT09894') HTTP/1.1" 204 0
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Scrape type for WB76864: 2
2026-03-29 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-29 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 825dd81e-9076-5079-9d23-98c279b4786f with scrape type 2
2026-03-29 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 825dd81e-9076-5079-9d23-98c279b4786f with scrape type 2
2026-03-29 06:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 825dd81e-9076-5079-9d23-98c279b4786f, identifier: WB76864
2026-03-29 06:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-29 06:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-29 06:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864 to the API
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'diesel',
 'id': '825dd81e-9076-5079-9d23-98c279b4786f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB76864',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 109364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2017}
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Saving data for WB76864: {'auction_closing_time': 1774884351.0, 'created_time': 1774557353.277715, 'last_price_update_time': 1774766165.507446}
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WB76864') HTTP/1.1" 204 0
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Scrape type for ZF81780: 2
2026-03-29 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-29 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with scrape type 2
2026-03-29 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with scrape type 2
2026-03-29 06:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd, identifier: ZF81780
2026-03-29 06:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-29 06:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-29 06:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780 to the API
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'diesel',
 'id': '41a330b3-77fb-5f45-a13c-30c8a3ef8bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF81780',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 117277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi HDi',
 'transmission': 'manual',
 'trim': 'HDi',
 'year': 2015}
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Saving data for ZF81780: {'auction_closing_time': 1774883505.0, 'created_time': 1773224453.84415, 'last_price_update_time': 1774766165.919583}
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF81780') HTTP/1.1" 204 0
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-29 06:36:05 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-29 06:36:05 [auto1.be] INFO: Scrape type for ET18736: 2
2026-03-29 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-29 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3247b2e-7a95-55d9-9f26-c42622767438 with scrape type 2
2026-03-29 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3247b2e-7a95-55d9-9f26-c42622767438 with scrape type 2
2026-03-29 06:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3247b2e-7a95-55d9-9f26-c42622767438, identifier: ET18736
2026-03-29 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-29 06:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-29 06:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736 to the API
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:07Z',
 'fuel_type': 'diesel',
 'id': 'a3247b2e-7a95-55d9-9f26-c42622767438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET18736',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Business Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Edition Start/Stop',
 'year': 2017}
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-29 06:36:06 [auto1.be] INFO: Saving data for ET18736: {'auction_closing_time': 1774885747.0, 'created_time': 1774643918.277404, 'last_price_update_time': 1774766166.348149}
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET18736') HTTP/1.1" 204 0
2026-03-29 06:36:06 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-29 06:36:06 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-29 06:36:06 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-29 06:36:06 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-29 06:36:06 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-29 06:36:06 [auto1.be] INFO: Scrape type for VW08902: 2
2026-03-29 06:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-29 06:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f4240f-d01b-514a-851b-e9a4f9711b5d with scrape type 2
2026-03-29 06:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f4240f-d01b-514a-851b-e9a4f9711b5d with scrape type 2
2026-03-29 06:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43f4240f-d01b-514a-851b-e9a4f9711b5d, identifier: VW08902
2026-03-29 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-29 06:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902 to the API
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:18:45Z',
 'fuel_type': 'gas',
 'id': '43f4240f-d01b-514a-851b-e9a4f9711b5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW08902',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 63942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-04',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-29 06:36:06 [auto1.be] INFO: Saving data for VW08902: {'auction_closing_time': 1774883925.0, 'created_time': 1774557488.841466, 'last_price_update_time': 1774766166.931272}
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW08902') HTTP/1.1" 204 0
2026-03-29 06:36:07 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-29 06:36:07 [auto1.be] INFO: Scrape type for FS38787: 2
2026-03-29 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-29 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b492033-8422-51be-bbf0-0322a3f6da80 with scrape type 2
2026-03-29 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b492033-8422-51be-bbf0-0322a3f6da80 with scrape type 2
2026-03-29 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b492033-8422-51be-bbf0-0322a3f6da80, identifier: FS38787
2026-03-29 06:36:07 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 16 pages/min), scraped 81 items (at 81 items/min)
2026-03-29 06:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-29 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-29 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787 to the API
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'diesel',
 'id': '5b492033-8422-51be-bbf0-0322a3f6da80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS38787',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 220154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-10',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2011}
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-29 06:36:07 [auto1.be] INFO: Saving data for FS38787: {'auction_closing_time': 1774883861.0, 'created_time': 1774643906.427234, 'last_price_update_time': 1774766167.439961}
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS38787') HTTP/1.1" 204 0
2026-03-29 06:36:07 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 06:36:07 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-29 06:36:07 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-29 06:36:07 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 06:36:07 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-29 06:36:07 [auto1.be] INFO: Scrape type for VU16052: 2
2026-03-29 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-29 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with scrape type 2
2026-03-29 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with scrape type 2
2026-03-29 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e, identifier: VU16052
2026-03-29 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-29 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-29 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052 to the API
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'diesel',
 'id': '262bea1c-b4eb-5202-a36b-4a2e9465aa0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU16052',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 95545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 D250 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-29 06:36:07 [auto1.be] INFO: Saving data for VU16052: {'auction_closing_time': 1774884960.0, 'created_time': 1774557558.197452, 'last_price_update_time': 1774766167.899367}
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU16052') HTTP/1.1" 204 0
2026-03-29 06:36:07 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-29 06:36:07 [auto1.be] INFO: Scrape type for HM47736: 2
2026-03-29 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-29 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17002efe-7880-5c23-ba84-ffe2498431cb with scrape type 2
2026-03-29 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17002efe-7880-5c23-ba84-ffe2498431cb with scrape type 2
2026-03-29 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17002efe-7880-5c23-ba84-ffe2498431cb, identifier: HM47736
2026-03-29 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-29 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-29 06:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736 to the API
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-30T15:32:56Z',
 'fuel_type': 'petrol',
 'id': '17002efe-7880-5c23-ba84-ffe2498431cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM47736',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 70589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-03',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-29 06:36:08 [auto1.be] INFO: Saving data for HM47736: {'auction_closing_time': 1774884776.0, 'created_time': 1774644015.818917, 'last_price_update_time': 1774766168.315764}
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM47736') HTTP/1.1" 204 0
2026-03-29 06:36:08 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-29 06:36:08 [auto1.be] INFO: Scrape type for GF03232: 2
2026-03-29 06:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-29 06:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with scrape type 2
2026-03-29 06:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with scrape type 2
2026-03-29 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71, identifier: GF03232
2026-03-29 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-29 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-29 06:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232 to the API
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:54:30Z',
 'fuel_type': 'diesel',
 'id': '14e2b49a-20f1-5b28-9d7f-68c6d5b2be71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF03232',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 157258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-16',
 'seller_name': None,
 'title': 'BMW 3er 316d Première',
 'transmission': 'manual',
 'trim': 'Première',
 'year': 2010}
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-29 06:36:08 [auto1.be] INFO: Saving data for GF03232: {'auction_closing_time': 1774886070.0, 'created_time': 1774557539.585204, 'last_price_update_time': 1774766168.731204}
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF03232') HTTP/1.1" 204 0
2026-03-29 06:36:08 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-29 06:36:08 [auto1.be] INFO: Scrape type for UC56570: 0
2026-03-29 06:36:08 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-29 06:36:08 [auto1.be] INFO: Scrape type for NN67810: 2
2026-03-29 06:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-29 06:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with scrape type 2
2026-03-29 06:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with scrape type 2
2026-03-29 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c, identifier: NN67810
2026-03-29 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-29 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-29 06:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810 to the API
2026-03-29 06:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:58:38Z',
 'fuel_type': 'hybrid',
 'id': '7c84a2c8-1673-5dc0-b808-2ff7f68abf5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN67810',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 53096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-29 06:36:09 [auto1.be] INFO: Saving data for NN67810: {'auction_closing_time': 1774886318.0, 'created_time': 1773909343.020222, 'last_price_update_time': 1774766169.17152}
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN67810') HTTP/1.1" 204 0
2026-03-29 06:36:09 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-29 06:36:09 [auto1.be] INFO: Scrape type for FE88671: 2
2026-03-29 06:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-29 06:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b57a36-f67c-58ea-80bb-01e854084220 with scrape type 2
2026-03-29 06:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45b57a36-f67c-58ea-80bb-01e854084220 with scrape type 2
2026-03-29 06:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45b57a36-f67c-58ea-80bb-01e854084220, identifier: FE88671
2026-03-29 06:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-29 06:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-29 06:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671 to the API
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'hybrid',
 'id': '45b57a36-f67c-58ea-80bb-01e854084220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE88671',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 71172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-29 06:36:09 [auto1.be] INFO: Saving data for FE88671: {'auction_closing_time': 1774885062.0, 'created_time': 1774643944.288816, 'last_price_update_time': 1774766169.582466}
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE88671') HTTP/1.1" 204 0
2026-03-29 06:36:09 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-29 06:36:09 [auto1.be] INFO: Scrape type for ZM54686: 2
2026-03-29 06:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-29 06:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f965cd-80bc-50d1-8249-4abc3c377c86 with scrape type 2
2026-03-29 06:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0f965cd-80bc-50d1-8249-4abc3c377c86 with scrape type 2
2026-03-29 06:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0f965cd-80bc-50d1-8249-4abc3c377c86, identifier: ZM54686
2026-03-29 06:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-29 06:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-29 06:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686 to the API
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'petrol',
 'id': 'c0f965cd-80bc-50d1-8249-4abc3c377c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54686',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 63877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-29 06:36:09 [auto1.be] INFO: Saving data for ZM54686: {'auction_closing_time': 1774885459.0, 'created_time': 1774643870.438204, 'last_price_update_time': 1774766169.983289}
2026-03-29 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM54686') HTTP/1.1" 204 0
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-29 06:36:10 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-29 06:36:10 [auto1.be] INFO: Scrape type for ZF78419: 2
2026-03-29 06:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-29 06:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with scrape type 2
2026-03-29 06:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with scrape type 2
2026-03-29 06:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f, identifier: ZF78419
2026-03-29 06:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-29 06:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-29 06:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419 to the API
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:48:43Z',
 'fuel_type': 'diesel',
 'id': '10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF78419',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 190486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TDI Greenline',
 'transmission': 'manual',
 'trim': 'Greenline',
 'year': 2011}
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-29 06:36:10 [auto1.be] INFO: Saving data for ZF78419: {'auction_closing_time': 1774885723.0, 'created_time': 1774643838.420648, 'last_price_update_time': 1774766170.469012}
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF78419') HTTP/1.1" 204 0
2026-03-29 06:36:10 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-29 06:36:10 [auto1.be] INFO: Scrape type for YM99739: 2
2026-03-29 06:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-29 06:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with scrape type 2
2026-03-29 06:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with scrape type 2
2026-03-29 06:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f8f74be6-f3a6-59bd-bb5e-569e69a5af36, identifier: YM99739
2026-03-29 06:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-29 06:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-29 06:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739 to the API
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:57:18Z',
 'fuel_type': 'diesel',
 'id': 'f8f74be6-f3a6-59bd-bb5e-569e69a5af36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM99739',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 134202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-29 06:36:10 [auto1.be] INFO: Saving data for YM99739: {'auction_closing_time': 1774886238.0, 'created_time': 1774557577.075723, 'last_price_update_time': 1774766170.905023}
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM99739') HTTP/1.1" 204 0
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 06:36:10 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-29 06:36:10 [auto1.be] INFO: Scrape type for YT15018: 2
2026-03-29 06:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018
2026-03-29 06:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3674d2-323c-5322-835c-f4857ed685fd with scrape type 2
2026-03-29 06:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3674d2-323c-5322-835c-f4857ed685fd with scrape type 2
2026-03-29 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac3674d2-323c-5322-835c-f4857ed685fd, identifier: YT15018
2026-03-29 06:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018
2026-03-29 06:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018
2026-03-29 06:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018 to the API
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:20:43Z',
 'fuel_type': 'petrol',
 'id': 'ac3674d2-323c-5322-835c-f4857ed685fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT15018',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 74129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Saving data for YT15018: {'auction_closing_time': 1774884043.0, 'created_time': 1774643959.209598, 'last_price_update_time': 1774766171.316389}
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YT15018') HTTP/1.1" 204 0
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Scrape type for PS72966: 2
2026-03-29 06:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-29 06:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfac3745-102b-5e51-88ec-ce03459d40c5 with scrape type 2
2026-03-29 06:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfac3745-102b-5e51-88ec-ce03459d40c5 with scrape type 2
2026-03-29 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfac3745-102b-5e51-88ec-ce03459d40c5, identifier: PS72966
2026-03-29 06:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-29 06:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-29 06:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966 to the API
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'diesel',
 'id': 'cfac3745-102b-5e51-88ec-ce03459d40c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS72966',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 43817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-25',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Saving data for PS72966: {'auction_closing_time': 1774884605.0, 'created_time': 1774643915.226094, 'last_price_update_time': 1774766171.755103}
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS72966') HTTP/1.1" 204 0
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Scrape type for HF54985: 0
2026-03-29 06:36:11 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-29 06:36:11 [auto1.be] INFO: Scrape type for GH94733: 2
2026-03-29 06:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-29 06:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad6bd01-d645-535d-aa6f-8b8f1581696b with scrape type 2
2026-03-29 06:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad6bd01-d645-535d-aa6f-8b8f1581696b with scrape type 2
2026-03-29 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aad6bd01-d645-535d-aa6f-8b8f1581696b, identifier: GH94733
2026-03-29 06:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-29 06:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-29 06:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733 to the API
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:33:52Z',
 'fuel_type': 'petrol',
 'id': 'aad6bd01-d645-535d-aa6f-8b8f1581696b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH94733',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 77344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'Fiat Punto 1.4 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2015}
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-29 06:36:12 [auto1.be] INFO: Saving data for GH94733: {'auction_closing_time': 1774884832.0, 'created_time': 1774643995.188131, 'last_price_update_time': 1774766172.284956}
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH94733') HTTP/1.1" 204 0
2026-03-29 06:36:12 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 06:36:12 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-29 06:36:12 [auto1.be] INFO: Scrape type for FA30680: 2
2026-03-29 06:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-29 06:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc0c507-bfc5-5a88-b516-bd9145a3f34b with scrape type 2
2026-03-29 06:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcc0c507-bfc5-5a88-b516-bd9145a3f34b with scrape type 2
2026-03-29 06:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcc0c507-bfc5-5a88-b516-bd9145a3f34b, identifier: FA30680
2026-03-29 06:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-29 06:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-29 06:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680 to the API
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:28Z',
 'fuel_type': 'petrol',
 'id': 'dcc0c507-bfc5-5a88-b516-bd9145a3f34b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA30680',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 51850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-17',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2023}
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-29 06:36:12 [auto1.be] INFO: Saving data for FA30680: {'auction_closing_time': 1774884688.0, 'created_time': 1773780035.362044, 'last_price_update_time': 1774766172.704299}
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA30680') HTTP/1.1" 204 0
2026-03-29 06:36:12 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-29 06:36:12 [auto1.be] INFO: Scrape type for WL65720: 2
2026-03-29 06:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-29 06:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with scrape type 2
2026-03-29 06:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with scrape type 2
2026-03-29 06:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2, identifier: WL65720
2026-03-29 06:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-29 06:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-29 06:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720 to the API
2026-03-29 06:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:12:38Z',
 'fuel_type': 'diesel',
 'id': '44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL65720',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-29 06:36:13 [auto1.be] INFO: Saving data for WL65720: {'auction_closing_time': 1774883558.0, 'created_time': 1774643973.099878, 'last_price_update_time': 1774766173.125114}
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL65720') HTTP/1.1" 204 0
2026-03-29 06:36:13 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-29 06:36:13 [auto1.be] INFO: Scrape type for KM67426: 2
2026-03-29 06:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-29 06:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c808e87-a02e-5910-b6c8-b37c9cf35179 with scrape type 2
2026-03-29 06:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c808e87-a02e-5910-b6c8-b37c9cf35179 with scrape type 2
2026-03-29 06:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c808e87-a02e-5910-b6c8-b37c9cf35179, identifier: KM67426
2026-03-29 06:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-29 06:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-29 06:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426 to the API
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:50Z',
 'fuel_type': 'diesel',
 'id': '3c808e87-a02e-5910-b6c8-b37c9cf35179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM67426',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 162410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-09',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2017}
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-29 06:36:13 [auto1.be] INFO: Saving data for KM67426: {'auction_closing_time': 1774884890.0, 'created_time': 1774557334.218393, 'last_price_update_time': 1774766173.540695}
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM67426') HTTP/1.1" 204 0
2026-03-29 06:36:13 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-29 06:36:13 [auto1.be] INFO: Scrape type for DM52841: 2
2026-03-29 06:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-29 06:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78477a3c-a638-585c-8cb2-230e49297ede with scrape type 2
2026-03-29 06:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78477a3c-a638-585c-8cb2-230e49297ede with scrape type 2
2026-03-29 06:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78477a3c-a638-585c-8cb2-230e49297ede, identifier: DM52841
2026-03-29 06:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-29 06:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-29 06:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841 to the API
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:15:30Z',
 'fuel_type': 'petrol',
 'id': '78477a3c-a638-585c-8cb2-230e49297ede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM52841',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 104842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-27',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-29 06:36:13 [auto1.be] INFO: Saving data for DM52841: {'auction_closing_time': 1774883730.0, 'created_time': 1774643910.219452, 'last_price_update_time': 1774766173.931503}
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM52841') HTTP/1.1" 204 0
2026-03-29 06:36:13 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-29 06:36:13 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-29 06:36:13 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Scrape type for DC47068: 2
2026-03-29 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-29 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2029733-bfb3-5a35-bf66-e33879308206 with scrape type 2
2026-03-29 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2029733-bfb3-5a35-bf66-e33879308206 with scrape type 2
2026-03-29 06:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2029733-bfb3-5a35-bf66-e33879308206, identifier: DC47068
2026-03-29 06:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-29 06:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-29 06:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068 to the API
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:20:08Z',
 'fuel_type': 'petrol',
 'id': 'd2029733-bfb3-5a35-bf66-e33879308206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC47068',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 105136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Saving data for DC47068: {'auction_closing_time': 1774884008.0, 'created_time': 1774557526.424423, 'last_price_update_time': 1774766174.393273}
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC47068') HTTP/1.1" 204 0
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Scrape type for VV25356: 2
2026-03-29 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-29 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fbf830-2835-5e03-8045-87bd14110175 with scrape type 2
2026-03-29 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fbf830-2835-5e03-8045-87bd14110175 with scrape type 2
2026-03-29 06:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98fbf830-2835-5e03-8045-87bd14110175, identifier: VV25356
2026-03-29 06:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-29 06:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-29 06:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356 to the API
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:27:02Z',
 'fuel_type': 'diesel',
 'id': '98fbf830-2835-5e03-8045-87bd14110175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV25356',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 49681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Saving data for VV25356: {'auction_closing_time': 1774884422.0, 'created_time': 1773822949.693674, 'last_price_update_time': 1774766174.941123}
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV25356') HTTP/1.1" 204 0
2026-03-29 06:36:14 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:14 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-29 06:36:14 [auto1.be] INFO: Scrape type for GS99704: 2
2026-03-29 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-29 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 with scrape type 2
2026-03-29 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 with scrape type 2
2026-03-29 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b974b1b6-19de-5e7d-90b5-ef53ef835da4, identifier: GS99704
2026-03-29 06:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-29 06:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-29 06:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704 to the API
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'diesel',
 'id': 'b974b1b6-19de-5e7d-90b5-ef53ef835da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS99704',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 161000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Saving data for GS99704: {'auction_closing_time': 1774884960.0, 'created_time': 1774643989.007071, 'last_price_update_time': 1774766175.361504}
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS99704') HTTP/1.1" 204 0
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Scrape type for SR93497: 2
2026-03-29 06:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-29 06:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb44c10-e870-5f23-ba13-d7d9521f4351 with scrape type 2
2026-03-29 06:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb44c10-e870-5f23-ba13-d7d9521f4351 with scrape type 2
2026-03-29 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb44c10-e870-5f23-ba13-d7d9521f4351, identifier: SR93497
2026-03-29 06:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 06:36:15 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Scrape type for NU98421: 2
2026-03-29 06:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-29 06:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925d536b-fe72-535e-ba07-122209d6df04 with scrape type 2
2026-03-29 06:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 925d536b-fe72-535e-ba07-122209d6df04 with scrape type 2
2026-03-29 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 925d536b-fe72-535e-ba07-122209d6df04, identifier: NU98421
2026-03-29 06:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-29 06:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-29 06:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497 to the API
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:46:40Z',
 'fuel_type': 'diesel',
 'id': '5cb44c10-e870-5f23-ba13-d7d9521f4351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR93497',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 213675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-29 06:36:15 [auto1.be] INFO: Saving data for SR93497: {'auction_closing_time': 1774885600.0, 'created_time': 1773779797.168772, 'last_price_update_time': 1774766175.914741}
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR93497') HTTP/1.1" 204 0
2026-03-29 06:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-29 06:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-29 06:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421 to the API
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:57Z',
 'fuel_type': 'diesel',
 'id': '925d536b-fe72-535e-ba07-122209d6df04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU98421',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 188143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2015}
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Saving data for NU98421: {'auction_closing_time': 1774884297.0, 'created_time': 1774644010.916528, 'last_price_update_time': 1774766176.376098}
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU98421') HTTP/1.1" 204 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for YR29884: 2
2026-03-29 06:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-29 06:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41970f1e-7c10-5801-9d46-d71c751dcf72 with scrape type 2
2026-03-29 06:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41970f1e-7c10-5801-9d46-d71c751dcf72 with scrape type 2
2026-03-29 06:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41970f1e-7c10-5801-9d46-d71c751dcf72, identifier: YR29884
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-29 06:36:16 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 06:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-29 06:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-29 06:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884 to the API
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:08:15Z',
 'fuel_type': 'diesel',
 'id': '41970f1e-7c10-5801-9d46-d71c751dcf72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR29884',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 217858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-29 06:36:16 [auto1.be] INFO: Saving data for YR29884: {'auction_closing_time': 1774883295.0, 'created_time': 1774557518.029565, 'last_price_update_time': 1774766176.940447}
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YR29884') HTTP/1.1" 204 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for NK28391: 2
2026-03-29 06:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-29 06:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with scrape type 2
2026-03-29 06:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with scrape type 2
2026-03-29 06:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c, identifier: NK28391
2026-03-29 06:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-29 06:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-29 06:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391 to the API
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'diesel',
 'id': 'f79b16c6-f2b0-5b80-94d2-ade444ee2d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK28391',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 144167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Renault Laguna 1.5 dCi Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2014}
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Saving data for NK28391: {'auction_closing_time': 1774885219.0, 'created_time': 1774557526.094866, 'last_price_update_time': 1774766177.432172}
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK28391') HTTP/1.1" 204 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for VZ78935: 2
2026-03-29 06:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-29 06:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with scrape type 2
2026-03-29 06:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with scrape type 2
2026-03-29 06:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb2f53c-6290-5dbe-95bc-2bb7b214bc69, identifier: VZ78935
2026-03-29 06:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-29 06:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-29 06:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935 to the API
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': 'efb2f53c-6290-5dbe-95bc-2bb7b214bc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ78935',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 277915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'automatic',
 'trim': 'clean diesel',
 'year': 2015}
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Saving data for VZ78935: {'auction_closing_time': 1774885702.0, 'created_time': 1774643995.53797, 'last_price_update_time': 1774766177.879204}
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ78935') HTTP/1.1" 204 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-29 06:36:17 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-29 06:36:17 [auto1.be] INFO: Scrape type for BV56621: 2
2026-03-29 06:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-29 06:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54af18b5-21b7-5c6d-b43c-996322979c28 with scrape type 2
2026-03-29 06:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54af18b5-21b7-5c6d-b43c-996322979c28 with scrape type 2
2026-03-29 06:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54af18b5-21b7-5c6d-b43c-996322979c28, identifier: BV56621
2026-03-29 06:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-29 06:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-29 06:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621 to the API
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'gas',
 'id': '54af18b5-21b7-5c6d-b43c-996322979c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV56621',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 147940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-29 06:36:18 [auto1.be] INFO: Saving data for BV56621: {'auction_closing_time': 1774885373.0, 'created_time': 1774644011.260984, 'last_price_update_time': 1774766178.352279}
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV56621') HTTP/1.1" 204 0
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-29 06:36:18 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-29 06:36:18 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 06:36:18 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 06:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:19 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-29 06:36:19 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-29 06:36:19 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-29 06:36:19 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-29 06:36:19 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-29 06:36:19 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 06:36:19 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-29 06:36:19 [auto1.be] INFO: Scrape type for ZZ47044: 2
2026-03-29 06:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-29 06:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76329f7b-2ec6-53ed-928c-109f9d364699 with scrape type 2
2026-03-29 06:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76329f7b-2ec6-53ed-928c-109f9d364699 with scrape type 2
2026-03-29 06:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76329f7b-2ec6-53ed-928c-109f9d364699, identifier: ZZ47044
2026-03-29 06:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 06:36:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-29 06:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044 to the API
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'diesel',
 'id': '76329f7b-2ec6-53ed-928c-109f9d364699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ47044',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 241719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-03',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2008}
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Saving data for ZZ47044: {'auction_closing_time': 1774883806.0, 'created_time': 1774643963.728874, 'last_price_update_time': 1774766180.02104}
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ47044') HTTP/1.1" 204 0
2026-03-29 06:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for FE56390: 2
2026-03-29 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-29 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b50d0127-601a-5821-98ae-9af60a6c557f with scrape type 2
2026-03-29 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b50d0127-601a-5821-98ae-9af60a6c557f with scrape type 2
2026-03-29 06:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b50d0127-601a-5821-98ae-9af60a6c557f, identifier: FE56390
2026-03-29 06:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-29 06:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-29 06:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390 to the API
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:43Z',
 'fuel_type': 'diesel',
 'id': 'b50d0127-601a-5821-98ae-9af60a6c557f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE56390',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 40092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Saving data for FE56390: {'auction_closing_time': 1774885543.0, 'created_time': 1773866677.280469, 'last_price_update_time': 1774766180.616913}
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE56390') HTTP/1.1" 204 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 06:36:20 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-29 06:36:20 [auto1.be] INFO: Scrape type for UL72077: 2
2026-03-29 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-29 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114e7634-f28a-5234-9918-f2f9b147ffe8 with scrape type 2
2026-03-29 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 114e7634-f28a-5234-9918-f2f9b147ffe8 with scrape type 2
2026-03-29 06:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 114e7634-f28a-5234-9918-f2f9b147ffe8, identifier: UL72077
2026-03-29 06:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-29 06:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-29 06:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077 to the API
2026-03-29 06:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:44:12Z',
 'fuel_type': 'petrol',
 'id': '114e7634-f28a-5234-9918-f2f9b147ffe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL72077',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 50514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Saving data for UL72077: {'auction_closing_time': 1774885452.0, 'created_time': 1774557542.208735, 'last_price_update_time': 1774766181.120852}
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL72077') HTTP/1.1" 204 0
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Scrape type for VZ08217: 2
2026-03-29 06:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-29 06:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with scrape type 2
2026-03-29 06:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with scrape type 2
2026-03-29 06:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f, identifier: VZ08217
2026-03-29 06:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-29 06:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-29 06:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217 to the API
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'diesel',
 'id': '3637e5af-02b9-5d3e-84f7-3dfaf610a57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ08217',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 117666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-20',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Saving data for VZ08217: {'auction_closing_time': 1774885985.0, 'created_time': 1774643839.440556, 'last_price_update_time': 1774766181.515668}
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ08217') HTTP/1.1" 204 0
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Scrape type for YL00049: 2
2026-03-29 06:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-29 06:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2f0edb-1049-5294-935f-63d616141fcd with scrape type 2
2026-03-29 06:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc2f0edb-1049-5294-935f-63d616141fcd with scrape type 2
2026-03-29 06:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc2f0edb-1049-5294-935f-63d616141fcd, identifier: YL00049
2026-03-29 06:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-29 06:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-29 06:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049 to the API
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'diesel',
 'id': 'dc2f0edb-1049-5294-935f-63d616141fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL00049',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 55452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Saving data for YL00049: {'auction_closing_time': 1774884670.0, 'created_time': 1774643894.520436, 'last_price_update_time': 1774766181.930899}
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL00049') HTTP/1.1" 204 0
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-29 06:36:21 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-29 06:36:21 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 06:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:23 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-29 06:36:23 [auto1.be] INFO: Scrape type for KC33551: 2
2026-03-29 06:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-29 06:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea5be3c-34ec-5c73-b35c-a191c18de72f with scrape type 2
2026-03-29 06:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea5be3c-34ec-5c73-b35c-a191c18de72f with scrape type 2
2026-03-29 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea5be3c-34ec-5c73-b35c-a191c18de72f, identifier: KC33551
2026-03-29 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-29 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-29 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551 to the API
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:13:00Z',
 'fuel_type': 'diesel',
 'id': '0ea5be3c-34ec-5c73-b35c-a191c18de72f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC33551',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 291273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-29 06:36:23 [auto1.be] INFO: Saving data for KC33551: {'auction_closing_time': 1774883580.0, 'created_time': 1773953365.939709, 'last_price_update_time': 1774766183.606297}
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC33551') HTTP/1.1" 204 0
2026-03-29 06:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-29 06:36:23 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-29 06:36:23 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-29 06:36:23 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-29 06:36:23 [auto1.be] INFO: Scrape type for VJ27978: 2
2026-03-29 06:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-29 06:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff84086-90db-5d0d-8aaa-41cb224de801 with scrape type 2
2026-03-29 06:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff84086-90db-5d0d-8aaa-41cb224de801 with scrape type 2
2026-03-29 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ff84086-90db-5d0d-8aaa-41cb224de801, identifier: VJ27978
2026-03-29 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-29 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-29 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978 to the API
2026-03-29 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:13Z',
 'fuel_type': 'petrol',
 'id': '1ff84086-90db-5d0d-8aaa-41cb224de801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ27978',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 76327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2022}
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-29 06:36:24 [auto1.be] INFO: Saving data for VJ27978: {'auction_closing_time': 1774885033.0, 'created_time': 1774557326.931693, 'last_price_update_time': 1774766184.149374}
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VJ27978') HTTP/1.1" 204 0
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-29 06:36:24 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-29 06:36:24 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-29 06:36:24 [auto1.be] INFO: Scrape type for JY53618: 2
2026-03-29 06:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-29 06:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 092b285f-2a02-5153-bb1b-d65a1605d8cd with scrape type 2
2026-03-29 06:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 092b285f-2a02-5153-bb1b-d65a1605d8cd with scrape type 2
2026-03-29 06:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 092b285f-2a02-5153-bb1b-d65a1605d8cd, identifier: JY53618
2026-03-29 06:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-29 06:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-29 06:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618 to the API
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:10:32Z',
 'fuel_type': 'diesel',
 'id': '092b285f-2a02-5153-bb1b-d65a1605d8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY53618',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 114433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Ford Transit 1.8 TDCi Kasten Lang Trend',
 'transmission': 'manual',
 'trim': 'Kasten Lang Trend',
 'year': 2013}
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-29 06:36:24 [auto1.be] INFO: Saving data for JY53618: {'auction_closing_time': 1774883432.0, 'created_time': 1773866710.151487, 'last_price_update_time': 1774766184.601096}
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY53618') HTTP/1.1" 204 0
2026-03-29 06:36:24 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-29 06:36:24 [auto1.be] INFO: Scrape type for VB55746: 2
2026-03-29 06:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-29 06:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with scrape type 2
2026-03-29 06:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with scrape type 2
2026-03-29 06:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18, identifier: VB55746
2026-03-29 06:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-29 06:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-29 06:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746 to the API
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:35:57Z',
 'fuel_type': 'petrol',
 'id': '7f52fa47-a3e2-5ce3-ac47-f9f69db83e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB55746',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 123897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Saving data for VB55746: {'auction_closing_time': 1774884957.0, 'created_time': 1774643902.035282, 'last_price_update_time': 1774766185.0821}
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB55746') HTTP/1.1" 204 0
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Scrape type for MG12074: 2
2026-03-29 06:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-29 06:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 with scrape type 2
2026-03-29 06:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 with scrape type 2
2026-03-29 06:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 233a848e-6c23-55cb-beeb-a529abb7e4c5, identifier: MG12074
2026-03-29 06:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-29 06:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-29 06:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074 to the API
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:46Z',
 'fuel_type': 'diesel',
 'id': '233a848e-6c23-55cb-beeb-a529abb7e4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG12074',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 181544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Saving data for MG12074: {'auction_closing_time': 1774885786.0, 'created_time': 1774643999.891409, 'last_price_update_time': 1774766185.496018}
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG12074') HTTP/1.1" 204 0
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 06:36:25 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Scrape type for SC59712: 2
2026-03-29 06:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-29 06:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 with scrape type 2
2026-03-29 06:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 with scrape type 2
2026-03-29 06:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a06debf-942b-59fe-aa39-cc2aa07606c9, identifier: SC59712
2026-03-29 06:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-29 06:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-29 06:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712 to the API
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:34:56Z',
 'fuel_type': 'diesel',
 'id': '0a06debf-942b-59fe-aa39-cc2aa07606c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC59712',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 98451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-25',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2018}
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-29 06:36:25 [auto1.be] INFO: Saving data for SC59712: {'auction_closing_time': 1774884896.0, 'created_time': 1774643985.486813, 'last_price_update_time': 1774766185.937626}
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC59712') HTTP/1.1" 204 0
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-29 06:36:26 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-29 06:36:26 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-29 06:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:26 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-29 06:36:26 [auto1.be] INFO: Scrape type for BN53670: 2
2026-03-29 06:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670
2026-03-29 06:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f94f707-0b65-50fa-ad19-d0c345ff6450 with scrape type 2
2026-03-29 06:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f94f707-0b65-50fa-ad19-d0c345ff6450 with scrape type 2
2026-03-29 06:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3f94f707-0b65-50fa-ad19-d0c345ff6450, identifier: BN53670
2026-03-29 06:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670
2026-03-29 06:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670
2026-03-29 06:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670 to the API
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:43:20Z',
 'fuel_type': 'petrol',
 'id': '3f94f707-0b65-50fa-ad19-d0c345ff6450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN53670',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 165616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-02',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-29 06:36:26 [auto1.be] INFO: Saving data for BN53670: {'auction_closing_time': 1774885400.0, 'created_time': 1774557506.683823, 'last_price_update_time': 1774766186.947143}
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BN53670') HTTP/1.1" 204 0
2026-03-29 06:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-29 06:36:26 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 06:36:26 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Scrape type for ZX33086: 2
2026-03-29 06:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-29 06:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411cec9e-6db0-5a65-8b95-919189bfb052 with scrape type 2
2026-03-29 06:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411cec9e-6db0-5a65-8b95-919189bfb052 with scrape type 2
2026-03-29 06:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 411cec9e-6db0-5a65-8b95-919189bfb052, identifier: ZX33086
2026-03-29 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-29 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-29 06:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086 to the API
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:22Z',
 'fuel_type': 'petrol',
 'id': '411cec9e-6db0-5a65-8b95-919189bfb052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX33086',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Saving data for ZX33086: {'auction_closing_time': 1774885102.0, 'created_time': 1774557403.37692, 'last_price_update_time': 1774766187.389033}
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX33086') HTTP/1.1" 204 0
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Scrape type for GS68920: 2
2026-03-29 06:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-29 06:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e83de13-45c4-53fa-9b3c-534652257f0b with scrape type 2
2026-03-29 06:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e83de13-45c4-53fa-9b3c-534652257f0b with scrape type 2
2026-03-29 06:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e83de13-45c4-53fa-9b3c-534652257f0b, identifier: GS68920
2026-03-29 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-29 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-29 06:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920 to the API
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '0e83de13-45c4-53fa-9b3c-534652257f0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS68920',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 293419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline',
 'transmission': 'manual',
 'trim': 'Maxi Trendline',
 'year': 2014}
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Saving data for GS68920: {'auction_closing_time': 1774885528.0, 'created_time': 1774557442.016866, 'last_price_update_time': 1774766187.931296}
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS68920') HTTP/1.1" 204 0
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-29 06:36:27 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 06:36:27 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-29 06:36:28 [auto1.be] INFO: Scrape type for XB11874: 2
2026-03-29 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-29 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with scrape type 2
2026-03-29 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with scrape type 2
2026-03-29 06:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99415bc3-21eb-5b1a-940a-2c85acecd4e8, identifier: XB11874
2026-03-29 06:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-29 06:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-29 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874 to the API
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:24:02Z',
 'fuel_type': 'diesel',
 'id': '99415bc3-21eb-5b1a-940a-2c85acecd4e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB11874',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 59945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-10',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-29 06:36:28 [auto1.be] INFO: Saving data for XB11874: {'auction_closing_time': 1774884242.0, 'created_time': 1774643956.570489, 'last_price_update_time': 1774766188.373532}
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB11874') HTTP/1.1" 204 0
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-29 06:36:28 [auto1.be] INFO: Scrape type for MX90898: 2
2026-03-29 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-29 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e2cdb9-51d7-5461-9e3c-886975dd210d with scrape type 2
2026-03-29 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e2cdb9-51d7-5461-9e3c-886975dd210d with scrape type 2
2026-03-29 06:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17e2cdb9-51d7-5461-9e3c-886975dd210d, identifier: MX90898
2026-03-29 06:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-29 06:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-29 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898 to the API
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:55:59Z',
 'fuel_type': 'petrol',
 'id': '17e2cdb9-51d7-5461-9e3c-886975dd210d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX90898',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 33245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-22',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Plus',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2024}
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-29 06:36:28 [auto1.be] INFO: Saving data for MX90898: {'auction_closing_time': 1774886159.0, 'created_time': 1774557501.045591, 'last_price_update_time': 1774766188.771598}
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX90898') HTTP/1.1" 204 0
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-29 06:36:28 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 06:36:28 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-29 06:36:28 [auto1.be] INFO: Scrape type for LF23330: 2
2026-03-29 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-29 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 789a9828-d901-5a3c-bfde-13ea36225351 with scrape type 2
2026-03-29 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 789a9828-d901-5a3c-bfde-13ea36225351 with scrape type 2
2026-03-29 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 789a9828-d901-5a3c-bfde-13ea36225351, identifier: LF23330
2026-03-29 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-29 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-29 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330 to the API
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:38Z',
 'fuel_type': 'diesel',
 'id': '789a9828-d901-5a3c-bfde-13ea36225351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF23330',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 220661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-08',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDIe Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-29 06:36:29 [auto1.be] INFO: Saving data for LF23330: {'auction_closing_time': 1774884038.0, 'created_time': 1774557332.108156, 'last_price_update_time': 1774766189.28623}
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF23330') HTTP/1.1" 204 0
2026-03-29 06:36:29 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-29 06:36:29 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-29 06:36:29 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 06:36:29 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-29 06:36:29 [auto1.be] INFO: Scrape type for AB25804: 2
2026-03-29 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-29 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1645fa-fb66-50ea-8f1e-283d5e7d561b with scrape type 2
2026-03-29 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1645fa-fb66-50ea-8f1e-283d5e7d561b with scrape type 2
2026-03-29 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd1645fa-fb66-50ea-8f1e-283d5e7d561b, identifier: AB25804
2026-03-29 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-29 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-29 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804 to the API
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:38:48Z',
 'fuel_type': 'petrol',
 'id': 'bd1645fa-fb66-50ea-8f1e-283d5e7d561b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB25804',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-14',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2025}
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-29 06:36:29 [auto1.be] INFO: Saving data for AB25804: {'auction_closing_time': 1774885128.0, 'created_time': 1774557515.802979, 'last_price_update_time': 1774766189.706043}
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB25804') HTTP/1.1" 204 0
2026-03-29 06:36:29 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 06:36:29 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-29 06:36:29 [auto1.be] INFO: Scrape type for AD33980: 2
2026-03-29 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-29 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bdc7506-262d-593d-b4d9-706bf3948b06 with scrape type 2
2026-03-29 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bdc7506-262d-593d-b4d9-706bf3948b06 with scrape type 2
2026-03-29 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bdc7506-262d-593d-b4d9-706bf3948b06, identifier: AD33980
2026-03-29 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-29 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-29 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980 to the API
2026-03-29 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:34:10Z',
 'fuel_type': 'diesel',
 'id': '2bdc7506-262d-593d-b4d9-706bf3948b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD33980',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 154183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-29 06:36:30 [auto1.be] INFO: Saving data for AD33980: {'auction_closing_time': 1774884850.0, 'created_time': 1774557578.647518, 'last_price_update_time': 1774766190.117562}
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD33980') HTTP/1.1" 204 0
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 06:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:30 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-29 06:36:30 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 06:36:30 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-29 06:36:30 [auto1.be] INFO: Scrape type for JC93215: 2
2026-03-29 06:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-29 06:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 with scrape type 2
2026-03-29 06:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 with scrape type 2
2026-03-29 06:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3eebaf58-74f5-5452-a391-ffcdcee41b69, identifier: JC93215
2026-03-29 06:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-29 06:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-29 06:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215 to the API
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:17:57Z',
 'fuel_type': 'diesel',
 'id': '3eebaf58-74f5-5452-a391-ffcdcee41b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC93215',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 341195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-07',
 'seller_name': None,
 'title': 'Audi A8 4.0 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2004}
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-29 06:36:30 [auto1.be] INFO: Saving data for JC93215: {'auction_closing_time': 1774883877.0, 'created_time': 1774643938.979034, 'last_price_update_time': 1774766190.965852}
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC93215') HTTP/1.1" 204 0
2026-03-29 06:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:31 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-29 06:36:31 [auto1.be] INFO: Scrape type for TD70367: 2
2026-03-29 06:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-29 06:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497437b8-5a84-5bda-a08c-1e6314a053c7 with scrape type 2
2026-03-29 06:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497437b8-5a84-5bda-a08c-1e6314a053c7 with scrape type 2
2026-03-29 06:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 497437b8-5a84-5bda-a08c-1e6314a053c7, identifier: TD70367
2026-03-29 06:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-29 06:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-29 06:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367 to the API
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'diesel',
 'id': '497437b8-5a84-5bda-a08c-1e6314a053c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD70367',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 192011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-12',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-29 06:36:31 [auto1.be] INFO: Saving data for TD70367: {'auction_closing_time': 1774884352.0, 'created_time': 1773920140.021664, 'last_price_update_time': 1774766191.732979}
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD70367') HTTP/1.1" 204 0
2026-03-29 06:36:31 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 06:36:31 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 06:36:31 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 06:36:31 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-29 06:36:31 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-29 06:36:31 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-29 06:36:31 [auto1.be] INFO: Scrape type for LP97900: 2
2026-03-29 06:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-29 06:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24fb04d-1ea3-5a18-8032-cb7db71dff9a with scrape type 2
2026-03-29 06:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24fb04d-1ea3-5a18-8032-cb7db71dff9a with scrape type 2
2026-03-29 06:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c24fb04d-1ea3-5a18-8032-cb7db71dff9a, identifier: LP97900
2026-03-29 06:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-29 06:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-29 06:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900 to the API
2026-03-29 06:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:27:35Z',
 'fuel_type': 'petrol',
 'id': 'c24fb04d-1ea3-5a18-8032-cb7db71dff9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP97900',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 156187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-29 06:36:32 [auto1.be] INFO: Saving data for LP97900: {'auction_closing_time': 1774884455.0, 'created_time': 1774557403.015356, 'last_price_update_time': 1774766192.166085}
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP97900') HTTP/1.1" 204 0
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-29 06:36:32 [auto1.be] INFO: Scrape type for RX86056: 2
2026-03-29 06:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-29 06:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with scrape type 2
2026-03-29 06:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with scrape type 2
2026-03-29 06:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0, identifier: RX86056
2026-03-29 06:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-29 06:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-29 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056 to the API
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:20Z',
 'fuel_type': 'petrol',
 'id': 'd55adb9d-1855-5e89-b8b1-4016a3f0f3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX86056',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 205833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2021}
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-29 06:36:32 [auto1.be] INFO: Saving data for RX86056: {'auction_closing_time': 1774883720.0, 'created_time': 1774557579.795658, 'last_price_update_time': 1774766192.644663}
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX86056') HTTP/1.1" 204 0
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-29 06:36:32 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 06:36:32 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-29 06:36:32 [auto1.be] INFO: Scrape type for RH32729: 2
2026-03-29 06:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-29 06:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with scrape type 2
2026-03-29 06:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with scrape type 2
2026-03-29 06:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772, identifier: RH32729
2026-03-29 06:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-29 06:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-29 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729 to the API
2026-03-29 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:26:48Z',
 'fuel_type': 'petrol',
 'id': '5cb30bfc-ec38-501b-9be5-bbf1a07fb772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH32729',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 107330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Jaguar XE 20t R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2018}
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-29 06:36:33 [auto1.be] INFO: Saving data for RH32729: {'auction_closing_time': 1774884408.0, 'created_time': 1774557413.38859, 'last_price_update_time': 1774766193.132629}
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH32729') HTTP/1.1" 204 0
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-29 06:36:33 [auto1.be] INFO: Scrape type for LT47332: 2
2026-03-29 06:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-29 06:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2d9e26-972c-549d-b944-52de0d5b2414 with scrape type 2
2026-03-29 06:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd2d9e26-972c-549d-b944-52de0d5b2414 with scrape type 2
2026-03-29 06:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd2d9e26-972c-549d-b944-52de0d5b2414, identifier: LT47332
2026-03-29 06:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-29 06:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-29 06:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332 to the API
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:44:15Z',
 'fuel_type': 'petrol',
 'id': 'fd2d9e26-972c-549d-b944-52de0d5b2414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT47332',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 176805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-02',
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-29 06:36:33 [auto1.be] INFO: Saving data for LT47332: {'auction_closing_time': 1774885455.0, 'created_time': 1774557430.26255, 'last_price_update_time': 1774766193.645185}
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT47332') HTTP/1.1" 204 0
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-29 06:36:33 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-29 06:36:33 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 06:36:33 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-29 06:36:33 [auto1.be] INFO: Scrape type for UA44051: 2
2026-03-29 06:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-29 06:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with scrape type 2
2026-03-29 06:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with scrape type 2
2026-03-29 06:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e, identifier: UA44051
2026-03-29 06:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-29 06:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-29 06:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051 to the API
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'diesel',
 'id': '76a5cf51-2799-5d31-9ca8-53fa6bc4766e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44051',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 162200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 300 K LKW',
 'transmission': 'manual',
 'trim': 'FT 300 K LKW',
 'year': 2008}
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Saving data for UA44051: {'auction_closing_time': 1774885991.0, 'created_time': 1774254987.486264, 'last_price_update_time': 1774766194.075422}
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA44051') HTTP/1.1" 204 0
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Scrape type for AT20959: 0
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Scrape type for XM10489: 2
2026-03-29 06:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-29 06:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f440364-48c8-56e5-b5b4-01812722451f with scrape type 2
2026-03-29 06:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f440364-48c8-56e5-b5b4-01812722451f with scrape type 2
2026-03-29 06:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f440364-48c8-56e5-b5b4-01812722451f, identifier: XM10489
2026-03-29 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-29 06:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-29 06:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489 to the API
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:05:49Z',
 'fuel_type': 'diesel',
 'id': '0f440364-48c8-56e5-b5b4-01812722451f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM10489',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 160771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-04',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi 15th',
 'transmission': 'manual',
 'trim': '15th',
 'year': 2011}
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Saving data for XM10489: {'auction_closing_time': 1774883149.0, 'created_time': 1774557536.624046, 'last_price_update_time': 1774766194.565494}
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM10489') HTTP/1.1" 204 0
2026-03-29 06:36:34 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-29 06:36:34 [auto1.be] INFO: Scrape type for RS45224: 2
2026-03-29 06:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-29 06:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with scrape type 2
2026-03-29 06:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with scrape type 2
2026-03-29 06:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0, identifier: RS45224
2026-03-29 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-29 06:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-29 06:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224 to the API
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:49Z',
 'fuel_type': 'diesel',
 'id': 'bcf8a864-bc50-59dc-a82d-e29ed5f9cef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS45224',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 155214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2015}
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-29 06:36:35 [auto1.be] INFO: Saving data for RS45224: {'auction_closing_time': 1774886029.0, 'created_time': 1774557400.059398, 'last_price_update_time': 1774766195.062891}
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS45224') HTTP/1.1" 204 0
2026-03-29 06:36:35 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-29 06:36:35 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-29 06:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:35 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:35 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 06:36:35 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 06:36:35 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-29 06:36:35 [auto1.be] INFO: Scrape type for XJ24324: 2
2026-03-29 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324
2026-03-29 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with scrape type 2
2026-03-29 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with scrape type 2
2026-03-29 06:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd7687a2-24e4-51a2-b63d-23fe3f5e1681, identifier: XJ24324
2026-03-29 06:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324
2026-03-29 06:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324
2026-03-29 06:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324 to the API
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:20Z',
 'fuel_type': 'petrol',
 'id': 'fd7687a2-24e4-51a2-b63d-23fe3f5e1681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ24324',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 109455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo ON Start/Stop',
 'transmission': 'automatic',
 'trim': 'ON Start/Stop',
 'year': 2017}
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-29 06:36:35 [auto1.be] INFO: Saving data for XJ24324: {'auction_closing_time': 1774885220.0, 'created_time': 1774643989.811715, 'last_price_update_time': 1774766195.595361}
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ24324') HTTP/1.1" 204 0
2026-03-29 06:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:35 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 06:36:35 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-29 06:36:35 [auto1.be] INFO: Scrape type for MZ51776: 2
2026-03-29 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-29 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6ac897-8ff7-5823-8019-bd26b347b4a1 with scrape type 2
2026-03-29 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe6ac897-8ff7-5823-8019-bd26b347b4a1 with scrape type 2
2026-03-29 06:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fe6ac897-8ff7-5823-8019-bd26b347b4a1, identifier: MZ51776
2026-03-29 06:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-29 06:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-29 06:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776 to the API
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:59:45Z',
 'fuel_type': 'diesel',
 'id': 'fe6ac897-8ff7-5823-8019-bd26b347b4a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ51776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 211489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-06',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Saving data for MZ51776: {'auction_closing_time': 1774886385.0, 'created_time': 1773834430.534744, 'last_price_update_time': 1774766196.009868}
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ51776') HTTP/1.1" 204 0
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Scrape type for HU58936: 2
2026-03-29 06:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-29 06:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with scrape type 2
2026-03-29 06:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with scrape type 2
2026-03-29 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c7a7961-d7b1-5951-a8eb-7c1d22350728, identifier: HU58936
2026-03-29 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-29 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-29 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936 to the API
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:04:40Z',
 'fuel_type': 'diesel',
 'id': '9c7a7961-d7b1-5951-a8eb-7c1d22350728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU58936',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 59840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2014}
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Saving data for HU58936: {'auction_closing_time': 1774883080.0, 'created_time': 1774644009.093823, 'last_price_update_time': 1774766196.427087}
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU58936') HTTP/1.1" 204 0
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-29 06:36:36 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Scrape type for KG53590: 2
2026-03-29 06:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-29 06:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00394349-364e-5ec8-99db-b307e0845906 with scrape type 2
2026-03-29 06:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00394349-364e-5ec8-99db-b307e0845906 with scrape type 2
2026-03-29 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00394349-364e-5ec8-99db-b307e0845906, identifier: KG53590
2026-03-29 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-29 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-29 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590 to the API
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'petrol',
 'id': '00394349-364e-5ec8-99db-b307e0845906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG53590',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 79099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2014}
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-29 06:36:36 [auto1.be] INFO: Saving data for KG53590: {'auction_closing_time': 1774885311.0, 'created_time': 1773834443.225994, 'last_price_update_time': 1774766196.934085}
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG53590') HTTP/1.1" 204 0
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Scrape type for ZX32272: 2
2026-03-29 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-29 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with scrape type 2
2026-03-29 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with scrape type 2
2026-03-29 06:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3, identifier: ZX32272
2026-03-29 06:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-29 06:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-29 06:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272 to the API
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:14:10Z',
 'fuel_type': 'diesel',
 'id': '9c4ce64c-ca92-5a37-9b73-bc3a62b723e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX32272',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 163844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Saving data for ZX32272: {'auction_closing_time': 1774883650.0, 'created_time': 1773866672.228361, 'last_price_update_time': 1774766197.43929}
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX32272') HTTP/1.1" 204 0
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Scrape type for NC57966: 2
2026-03-29 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-29 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a06727b-0917-5c59-8ec7-31b454997a54 with scrape type 2
2026-03-29 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a06727b-0917-5c59-8ec7-31b454997a54 with scrape type 2
2026-03-29 06:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a06727b-0917-5c59-8ec7-31b454997a54, identifier: NC57966
2026-03-29 06:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-29 06:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-29 06:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966 to the API
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:30:23Z',
 'fuel_type': 'petrol',
 'id': '4a06727b-0917-5c59-8ec7-31b454997a54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC57966',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Saving data for NC57966: {'auction_closing_time': 1774884623.0, 'created_time': 1774557446.262756, 'last_price_update_time': 1774766197.856563}
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC57966') HTTP/1.1" 204 0
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-29 06:36:37 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-29 06:36:37 [auto1.be] INFO: Scrape type for VA32651: 2
2026-03-29 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-29 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 with scrape type 2
2026-03-29 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 with scrape type 2
2026-03-29 06:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f9f557a-eaef-5d49-8a8c-25c71a222914, identifier: VA32651
2026-03-29 06:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-29 06:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-29 06:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651 to the API
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'petrol',
 'id': '9f9f557a-eaef-5d49-8a8c-25c71a222914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA32651',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 202806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2015}
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Saving data for VA32651: {'auction_closing_time': 1774885291.0, 'created_time': 1774643958.862555, 'last_price_update_time': 1774766198.306995}
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA32651') HTTP/1.1" 204 0
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Scrape type for MZ96160: 2
2026-03-29 06:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-29 06:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with scrape type 2
2026-03-29 06:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with scrape type 2
2026-03-29 06:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f, identifier: MZ96160
2026-03-29 06:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-29 06:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-29 06:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160 to the API
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:46:00Z',
 'fuel_type': 'hybrid',
 'id': 'df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ96160',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 23940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-03',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Saving data for MZ96160: {'auction_closing_time': 1774885560.0, 'created_time': 1774557552.121896, 'last_price_update_time': 1774766198.861463}
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ96160') HTTP/1.1" 204 0
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 06:36:38 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-29 06:36:38 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-29 06:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:39 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Scrape type for BY25509: 2
2026-03-29 06:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-29 06:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c87b4f-87da-5497-9e21-528da080e9ee with scrape type 2
2026-03-29 06:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c87b4f-87da-5497-9e21-528da080e9ee with scrape type 2
2026-03-29 06:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16c87b4f-87da-5497-9e21-528da080e9ee, identifier: BY25509
2026-03-29 06:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-29 06:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-29 06:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509 to the API
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:23:36Z',
 'fuel_type': 'hybrid',
 'id': '16c87b4f-87da-5497-9e21-528da080e9ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY25509',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 204135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300de T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2020}
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Saving data for BY25509: {'auction_closing_time': 1774884216.0, 'created_time': 1774557572.117998, 'last_price_update_time': 1774766199.448032}
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY25509') HTTP/1.1" 204 0
2026-03-29 06:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 06:36:39 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Scrape type for FZ81347: 2
2026-03-29 06:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-29 06:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d86124-31f4-5341-8e00-dd7766516c02 with scrape type 2
2026-03-29 06:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d86124-31f4-5341-8e00-dd7766516c02 with scrape type 2
2026-03-29 06:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5d86124-31f4-5341-8e00-dd7766516c02, identifier: FZ81347
2026-03-29 06:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-29 06:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-29 06:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347 to the API
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:35:08Z',
 'fuel_type': 'petrol',
 'id': 'e5d86124-31f4-5341-8e00-dd7766516c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ81347',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 197758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2018}
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-29 06:36:39 [auto1.be] INFO: Saving data for FZ81347: {'auction_closing_time': 1774884908.0, 'created_time': 1774557442.29652, 'last_price_update_time': 1774766199.989012}
2026-03-29 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FZ81347') HTTP/1.1" 204 0
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-29 06:36:40 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-29 06:36:40 [auto1.be] INFO: Scrape type for FR50529: 2
2026-03-29 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-29 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3ee22-69db-552c-8395-dc8bade66c5b with scrape type 2
2026-03-29 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b3ee22-69db-552c-8395-dc8bade66c5b with scrape type 2
2026-03-29 06:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8b3ee22-69db-552c-8395-dc8bade66c5b, identifier: FR50529
2026-03-29 06:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-29 06:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-29 06:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529 to the API
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:25:46Z',
 'fuel_type': 'diesel',
 'id': 'd8b3ee22-69db-552c-8395-dc8bade66c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR50529',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 154582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2020}
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-29 06:36:40 [auto1.be] INFO: Saving data for FR50529: {'auction_closing_time': 1774884346.0, 'created_time': 1774643962.48001, 'last_price_update_time': 1774766200.403732}
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR50529') HTTP/1.1" 204 0
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-29 06:36:40 [auto1.be] INFO: Scrape type for PY41942: 2
2026-03-29 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-29 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898f5281-625c-5310-aa5c-5592895a4d7a with scrape type 2
2026-03-29 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898f5281-625c-5310-aa5c-5592895a4d7a with scrape type 2
2026-03-29 06:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 898f5281-625c-5310-aa5c-5592895a4d7a, identifier: PY41942
2026-03-29 06:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-29 06:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-29 06:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942 to the API
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:27:41Z',
 'fuel_type': 'petrol',
 'id': '898f5281-625c-5310-aa5c-5592895a4d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY41942',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 92494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-08',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-29 06:36:40 [auto1.be] INFO: Saving data for PY41942: {'auction_closing_time': 1774884461.0, 'created_time': 1774557438.170411, 'last_price_update_time': 1774766200.901977}
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY41942') HTTP/1.1" 204 0
2026-03-29 06:36:40 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-29 06:36:40 [auto1.be] INFO: Scrape type for TP16646: 2
2026-03-29 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-29 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19e2218-b800-5812-afe4-a97b7adc0024 with scrape type 2
2026-03-29 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19e2218-b800-5812-afe4-a97b7adc0024 with scrape type 2
2026-03-29 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b19e2218-b800-5812-afe4-a97b7adc0024, identifier: TP16646
2026-03-29 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-29 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-29 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646 to the API
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:26:22Z',
 'fuel_type': 'petrol',
 'id': 'b19e2218-b800-5812-afe4-a97b7adc0024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP16646',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 127886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-29 06:36:41 [auto1.be] INFO: Saving data for TP16646: {'auction_closing_time': 1774884382.0, 'created_time': 1773301759.237631, 'last_price_update_time': 1774766201.304251}
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP16646') HTTP/1.1" 204 0
2026-03-29 06:36:41 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 06:36:41 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 06:36:41 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-29 06:36:41 [auto1.be] INFO: Scrape type for RU48742: 2
2026-03-29 06:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-29 06:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df166cc3-cd8a-5d39-8640-02d6c5ff48ea with scrape type 2
2026-03-29 06:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df166cc3-cd8a-5d39-8640-02d6c5ff48ea with scrape type 2
2026-03-29 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df166cc3-cd8a-5d39-8640-02d6c5ff48ea, identifier: RU48742
2026-03-29 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-29 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-29 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742 to the API
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:35:09Z',
 'fuel_type': 'diesel',
 'id': 'df166cc3-cd8a-5d39-8640-02d6c5ff48ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU48742',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 108378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2020}
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-29 06:36:41 [auto1.be] INFO: Saving data for RU48742: {'auction_closing_time': 1774884909.0, 'created_time': 1773131807.255326, 'last_price_update_time': 1774766201.73338}
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU48742') HTTP/1.1" 204 0
2026-03-29 06:36:41 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-29 06:36:41 [auto1.be] INFO: Scrape type for DK63787: 2
2026-03-29 06:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-29 06:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with scrape type 2
2026-03-29 06:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with scrape type 2
2026-03-29 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f638d8af-4889-5e8d-9674-aa20a8d4f5a8, identifier: DK63787
2026-03-29 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-29 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-29 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787 to the API
2026-03-29 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:23:33Z',
 'fuel_type': 'diesel',
 'id': 'f638d8af-4889-5e8d-9674-aa20a8d4f5a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK63787',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 85511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Active',
 'transmission': 'manual',
 'trim': 'Multijet Active',
 'year': 2010}
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Saving data for DK63787: {'auction_closing_time': 1774884213.0, 'created_time': 1774557489.451068, 'last_price_update_time': 1774766202.162073}
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK63787') HTTP/1.1" 204 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for HU17820: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for NV75936: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for AW25378: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for LS82290: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 06:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:42 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for CM51817: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for RD23593: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for GD95033: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for LG99308: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for KW17867: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for HS15781: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for HT80629: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for FT23017: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for MY75694: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for LH19076: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for FT86060: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for TF49476: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for JT63704: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for SX16585: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for TF43790: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for LF44164: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for SV00163: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for VM07385: 0
2026-03-29 06:36:42 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-29 06:36:42 [auto1.be] INFO: Scrape type for WC19794: 0
2026-03-29 06:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:43 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-29 06:36:43 [auto1.be] INFO: Scrape type for SB51494: 0
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-29 06:36:43 [auto1.be] INFO: Scrape type for KM81672: 0
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-29 06:36:43 [auto1.be] INFO: Scrape type for JC37428: 0
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-29 06:36:43 [auto1.be] INFO: Scrape type for BT48733: 0
2026-03-29 06:36:43 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for JM52918: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for PJ47204: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for WV93881: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for WV93759: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for HZ76034: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for US61524: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for WJ93890: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for DN00999: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for ZW40078: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for YW96446: 0
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 06:36:44 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-29 06:36:44 [auto1.be] INFO: Scrape type for UE64828: 0
2026-03-29 06:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:45 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for KF94293: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for LM13926: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for AE63964: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for SL57288: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for RK43455: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for FB93927: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for SV46049: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for WV65314: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for FM81572: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for MW50956: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for DN28044: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for WG38275: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for NC08569: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for CF30779: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for WT53046: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for DR48094: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for JZ34939: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for TX04561: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for BC33060: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for EP00364: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for HB59214: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for SX95001: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-29 06:36:45 [auto1.be] INFO: Scrape type for UR33188: 0
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 06:36:45 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 06:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:46 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for FJ57746: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for KZ05274: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for HK87235: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for CD22470: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for SJ05954: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for FV90992: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for PG48700: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for DC62563: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for ZP95092: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for ZR35447: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-29 06:36:46 [auto1.be] INFO: Scrape type for CA54828: 0
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 06:36:46 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for FW70524: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for NZ74768: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for AC55620: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for YZ92764: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for ZZ63767: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for VW23905: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-29 06:36:47 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-29 06:36:47 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 06:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:48 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for XC95069: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for BS70441: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for GM14941: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for SY87797: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for ZV95387: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for KB40459: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for ZZ39097: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for SC10935: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for BU18930: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for CN37182: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for EK79460: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for KE51169: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for XS76018: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for UY92003: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for NV64774: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for ET88330: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for KT00341: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for YH90615: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for CU35051: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-29 06:36:48 [auto1.be] INFO: Scrape type for PK02246: 0
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 06:36:48 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-29 06:36:49 [auto1.be] INFO: Scrape type for LY17098: 0
2026-03-29 06:36:49 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-29 06:36:49 [auto1.be] INFO: Scrape type for FC78029: 0
2026-03-29 06:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:50 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for EH00335: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for WH49963: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for KL53758: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for RA73981: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for EJ96142: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for HE39793: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for DD83263: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for SW21472: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for EY57880: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for ZN56944: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for HX50025: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for DH53723: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for RD62823: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for ZG72967: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for UH00217: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for JY01361: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for EU75132: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for FK09845: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for EB31921: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for DJ63605: 0
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 06:36:50 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-29 06:36:50 [auto1.be] INFO: Scrape type for TC61218: 0
2026-03-29 06:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:51 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1093 | hits on page: 40
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for PP72448: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for EV21741: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for BZ95673: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for AG16412: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for TM16327: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for UC18604: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-29 06:36:51 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 06:36:51 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-29 06:36:52 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-29 06:36:52 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 06:36:52 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-29 06:36:52 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-29 06:36:52 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 06:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:53 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1094 | hits on page: 14
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-29 06:36:53 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-29 06:36:53 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 06:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 06:36:54 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1094 | hits on page: 0
2026-03-29 06:36:54 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 06:36:54 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-29 06:36:54 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 159, <ScrapeType.BATCH_SKIPPED: 5>: 152}
2026-03-29 06:36:54 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (149 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-29T06_35_00.jl
2026-03-29 06:36:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 90755,
 'downloader/request_count': 33,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 31,
 'downloader/response_bytes': 5242823,
 'downloader/response_count': 33,
 'downloader/response_status_count/200': 33,
 'elapsed_time_seconds': 107.836187,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 6, 36, 54, 809554, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 149,
 'log_count/DEBUG': 2272,
 'log_count/INFO': 2970,
 'memusage/max': 164478976,
 'memusage/startup': 149880832,
 'request_depth_max': 32,
 'response_received_count': 33,
 'scheduler/dequeued': 33,
 'scheduler/dequeued/memory': 33,
 'scheduler/enqueued': 33,
 'scheduler/enqueued/memory': 33,
 'scrape_type/batch_skipped': 579,
 'scrape_type/price_update': 149,
 'scrape_type/skipped': 406,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 33,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.3239341984841637,
 'scrapy-zyte-api/mean_response_seconds': 2.436268377160146,
 'scrapy-zyte-api/processed': 33,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 33,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 32,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 33,
 'scrapy-zyte-api/request_args/httpRequestBody': 31,
 'scrapy-zyte-api/request_args/httpRequestMethod': 31,
 'scrapy-zyte-api/request_args/httpResponseBody': 33,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 33,
 'scrapy-zyte-api/request_args/sessionContext': 33,
 'scrapy-zyte-api/request_args/url': 33,
 'scrapy-zyte-api/status_codes/200': 33,
 'scrapy-zyte-api/success': 33,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1134,
 'source/total_available': 1094,
 'start_time': datetime.datetime(2026, 3, 29, 6, 35, 6, 973367, tzinfo=datetime.timezone.utc)}
2026-03-29 06:36:54 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 06:36:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7feb1dd5e750>
2026-03-29 06:36:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7feb1c48c190>