2026-03-29 20:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 20:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 20:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-29 20:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 20:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 20:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 20:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 20:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 20:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: 46106e74540c48c4
2026-03-29 20:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 20:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-29T20_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 20:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 20:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 20:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 20:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 20:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-29 20:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 20:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 20:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 20:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 20:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 20:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 20:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 20:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 20:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 20:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 20:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 20:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 20:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 20:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 20:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 20:35:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:16 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-29 20:35:16 [auto1.be] INFO: Scrape type for HD96937: 2
2026-03-29 20:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937
2026-03-29 20:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f with scrape type 2
2026-03-29 20:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f with scrape type 2
2026-03-29 20:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31b9b3c9-d549-53fa-a547-9b191e84cb1f, identifier: HD96937
2026-03-29 20:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 20:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 20:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937
2026-03-29 20:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937 to the API
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:31:48Z',
 'fuel_type': 'diesel',
 'id': '31b9b3c9-d549-53fa-a547-9b191e84cb1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD96937',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 165977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-11',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-29 20:35:17 [auto1.be] INFO: Saving data for HD96937: {'auction_closing_time': 1774884708.0, 'created_time': 1774643898.223455, 'last_price_update_time': 1774816517.067099}
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HD96937') HTTP/1.1" 204 0
2026-03-29 20:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:17 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-29 20:35:17 [auto1.be] INFO: Scrape type for NE40925: 2
2026-03-29 20:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925
2026-03-29 20:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194879e1-6c5e-5f27-93c6-5c392dcee510 with scrape type 2
2026-03-29 20:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 194879e1-6c5e-5f27-93c6-5c392dcee510 with scrape type 2
2026-03-29 20:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 194879e1-6c5e-5f27-93c6-5c392dcee510, identifier: NE40925
2026-03-29 20:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 20:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925
2026-03-29 20:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925 to the API
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:03:29Z',
 'fuel_type': 'diesel',
 'id': '194879e1-6c5e-5f27-93c6-5c392dcee510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE40925',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 312283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-01',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-29 20:35:17 [auto1.be] INFO: Saving data for NE40925: {'auction_closing_time': 1774883009.0, 'created_time': 1774557460.203722, 'last_price_update_time': 1774816517.746525}
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE40925') HTTP/1.1" 204 0
2026-03-29 20:35:17 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-29 20:35:17 [auto1.be] INFO: Scrape type for TU29469: 2
2026-03-29 20:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469
2026-03-29 20:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d47226-a315-5bb7-843c-777c4a00a5b5 with scrape type 2
2026-03-29 20:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d47226-a315-5bb7-843c-777c4a00a5b5 with scrape type 2
2026-03-29 20:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07d47226-a315-5bb7-843c-777c4a00a5b5, identifier: TU29469
2026-03-29 20:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469
2026-03-29 20:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469
2026-03-29 20:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469 to the API
2026-03-29 20:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:11:52Z',
 'fuel_type': 'diesel',
 'id': '07d47226-a315-5bb7-843c-777c4a00a5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU29469',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 222315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-29 20:35:18 [auto1.be] INFO: Saving data for TU29469: {'auction_closing_time': 1774883512.0, 'created_time': 1774557418.378737, 'last_price_update_time': 1774816518.165293}
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU29469') HTTP/1.1" 204 0
2026-03-29 20:35:18 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-29 20:35:18 [auto1.be] INFO: Scrape type for ZP62550: 2
2026-03-29 20:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550
2026-03-29 20:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162ffae6-e742-5a79-87e3-449d0db578ef with scrape type 2
2026-03-29 20:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162ffae6-e742-5a79-87e3-449d0db578ef with scrape type 2
2026-03-29 20:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 162ffae6-e742-5a79-87e3-449d0db578ef, identifier: ZP62550
2026-03-29 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550
2026-03-29 20:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550 to the API
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:49Z',
 'fuel_type': 'petrol',
 'id': '162ffae6-e742-5a79-87e3-449d0db578ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP62550',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 198659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-22',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-29 20:35:18 [auto1.be] INFO: Saving data for ZP62550: {'auction_closing_time': 1774883389.0, 'created_time': 1774384723.78201, 'last_price_update_time': 1774816518.675116}
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP62550') HTTP/1.1" 204 0
2026-03-29 20:35:18 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-29 20:35:18 [auto1.be] INFO: Scrape type for RK88808: 2
2026-03-29 20:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808
2026-03-29 20:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with scrape type 2
2026-03-29 20:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with scrape type 2
2026-03-29 20:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70, identifier: RK88808
2026-03-29 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808
2026-03-29 20:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808 to the API
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:07:40Z',
 'fuel_type': 'petrol',
 'id': '77a25f8c-4baa-5ce3-afb0-63316d0f5c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK88808',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 118799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2019}
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Saving data for RK88808: {'auction_closing_time': 1774883260.0, 'created_time': 1774643904.956833, 'last_price_update_time': 1774816519.218894}
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK88808') HTTP/1.1" 204 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for LG48907: 2
2026-03-29 20:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907
2026-03-29 20:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c419b186-aadc-5314-aa68-46ecded792e9 with scrape type 2
2026-03-29 20:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c419b186-aadc-5314-aa68-46ecded792e9 with scrape type 2
2026-03-29 20:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c419b186-aadc-5314-aa68-46ecded792e9, identifier: LG48907
2026-03-29 20:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907
2026-03-29 20:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907
2026-03-29 20:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907 to the API
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:40:13Z',
 'fuel_type': 'diesel',
 'id': 'c419b186-aadc-5314-aa68-46ecded792e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG48907',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 179052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-01',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Saving data for LG48907: {'auction_closing_time': 1774885213.0, 'created_time': 1774643976.953083, 'last_price_update_time': 1774816519.682158}
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG48907') HTTP/1.1" 204 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for DT10357: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for SW43031: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for KH45960: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for AM39981: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 20:35:19 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 20:35:19 [auto1.be] INFO: Scrape type for RJ01486: 2
2026-03-29 20:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-29 20:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with scrape type 2
2026-03-29 20:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with scrape type 2
2026-03-29 20:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f, identifier: RJ01486
2026-03-29 20:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 20:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-29 20:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486 to the API
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:28:19Z',
 'fuel_type': 'petrol',
 'id': '4ea3fdf4-850d-5507-bda1-a0321c4b8a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ01486',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 118811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Saving data for RJ01486: {'auction_closing_time': 1774884499.0, 'created_time': 1773133983.568671, 'last_price_update_time': 1774816520.51745}
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ01486') HTTP/1.1" 204 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for WP77155: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for CY85383: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 20:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:20 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for DT10357: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for SW43031: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for KH45960: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 20:35:20 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-29 20:35:20 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for AM39981: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for WP77155: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for CY85383: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 20:35:21 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 20:35:21 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 20:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:22 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-29 20:35:22 [auto1.be] INFO: Scrape type for RX06086: 0
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-29 20:35:22 [auto1.be] INFO: Scrape type for PE70540: 2
2026-03-29 20:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-29 20:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with scrape type 2
2026-03-29 20:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with scrape type 2
2026-03-29 20:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb, identifier: PE70540
2026-03-29 20:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-29 20:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-29 20:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540 to the API
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:07:40Z',
 'fuel_type': 'petrol',
 'id': '9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE70540',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 184331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2013}
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-29 20:35:22 [auto1.be] INFO: Saving data for PE70540: {'auction_closing_time': 1774883260.0, 'created_time': 1773239461.286606, 'last_price_update_time': 1774816522.85017}
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE70540') HTTP/1.1" 204 0
2026-03-29 20:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-29 20:35:22 [auto1.be] INFO: Scrape type for KT58942: 0
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-29 20:35:22 [auto1.be] INFO: Scrape type for UY87343: 0
2026-03-29 20:35:22 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-29 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for MH83966: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for AD76625: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for HX23250: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for DH89229: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for UZ99297: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for DZ79289: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for EP64027: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for ZY04103: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for PZ32696: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for SD10160: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for YA34487: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for RC41327: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for BL31735: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for PJ34917: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for TM16461: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for KD33371: 0
2026-03-29 20:35:23 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-29 20:35:23 [auto1.be] INFO: Scrape type for ZM02853: 0
2026-03-29 20:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:24 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for ZP04877: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for BY53413: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for LY35485: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for KU68109: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for VL25326: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for XY08671: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for BY20726: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for KF56069: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for BV02466: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for SY52065: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for NG60197: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for YR77899: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for UA36767: 0
2026-03-29 20:35:24 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-29 20:35:24 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-29 20:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:25 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for WA86347: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for PS31946: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for ZP25114: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for FP22064: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for LU53556: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for TT03576: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for CM14446: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for VE29498: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for AM49333: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for FC05247: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for NC38410: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for TX69988: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-29 20:35:25 [auto1.be] INFO: Scrape type for HK94342: 0
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-29 20:35:25 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-29 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-29 20:35:26 [auto1.be] INFO: Scrape type for SL05027: 0
2026-03-29 20:35:26 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-29 20:35:26 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-29 20:35:26 [auto1.be] INFO: Scrape type for EK47235: 0
2026-03-29 20:35:26 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-29 20:35:26 [auto1.be] INFO: Scrape type for SJ26894: 0
2026-03-29 20:35:26 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-29 20:35:26 [auto1.be] INFO: Scrape type for VP06293: 0
2026-03-29 20:35:26 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-29 20:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:30 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for DH17925: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for UX80051: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for MG99487: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for FG10633: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for KE27400: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 20:35:30 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-29 20:35:30 [auto1.be] INFO: Scrape type for ML65590: 2
2026-03-29 20:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590
2026-03-29 20:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05db3c68-37cd-513b-995b-87034a44aa05 with scrape type 2
2026-03-29 20:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05db3c68-37cd-513b-995b-87034a44aa05 with scrape type 2
2026-03-29 20:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 05db3c68-37cd-513b-995b-87034a44aa05, identifier: ML65590
2026-03-29 20:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590
2026-03-29 20:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590
2026-03-29 20:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590 to the API
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'diesel',
 'id': '05db3c68-37cd-513b-995b-87034a44aa05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML65590',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 64891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-29 20:35:31 [auto1.be] INFO: Saving data for ML65590: {'auction_closing_time': 1774882978.0, 'created_time': 1773384529.883265, 'last_price_update_time': 1774816531.556252}
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML65590') HTTP/1.1" 204 0
2026-03-29 20:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:31 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 20:35:31 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 20:35:31 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-29 20:35:31 [auto1.be] INFO: Scrape type for YU22338: 2
2026-03-29 20:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338
2026-03-29 20:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef0f2788-a007-5a3e-be0d-6826cf341be2 with scrape type 2
2026-03-29 20:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef0f2788-a007-5a3e-be0d-6826cf341be2 with scrape type 2
2026-03-29 20:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef0f2788-a007-5a3e-be0d-6826cf341be2, identifier: YU22338
2026-03-29 20:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338
2026-03-29 20:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338
2026-03-29 20:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338 to the API
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:23:08Z',
 'fuel_type': 'petrol',
 'id': 'ef0f2788-a007-5a3e-be0d-6826cf341be2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU22338',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 18940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-29 20:35:32 [auto1.be] INFO: Saving data for YU22338: {'auction_closing_time': 1774884188.0, 'created_time': 1774730125.842692, 'last_price_update_time': 1774816532.057276}
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU22338') HTTP/1.1" 204 0
2026-03-29 20:35:32 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-29 20:35:32 [auto1.be] INFO: Scrape type for SW98803: 2
2026-03-29 20:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803
2026-03-29 20:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with scrape type 2
2026-03-29 20:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with scrape type 2
2026-03-29 20:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4, identifier: SW98803
2026-03-29 20:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803
2026-03-29 20:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803
2026-03-29 20:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803 to the API
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:06:01Z',
 'fuel_type': 'diesel',
 'id': '1ab6483d-3294-57fe-8f2e-fa50f9aa40d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW98803',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-06',
 'seller_name': None,
 'title': 'Ssangyong Korando 2.2 TD Sapphire 4x4',
 'transmission': 'manual',
 'trim': 'Sapphire 4x4',
 'year': 2017}
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-29 20:35:32 [auto1.be] INFO: Saving data for SW98803: {'auction_closing_time': 1774883161.0, 'created_time': 1774730125.361688, 'last_price_update_time': 1774816532.67473}
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW98803') HTTP/1.1" 204 0
2026-03-29 20:35:32 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-29 20:35:32 [auto1.be] INFO: Scrape type for LP50838: 2
2026-03-29 20:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838
2026-03-29 20:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef966229-e609-529e-b6e0-773252aa68c3 with scrape type 2
2026-03-29 20:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef966229-e609-529e-b6e0-773252aa68c3 with scrape type 2
2026-03-29 20:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef966229-e609-529e-b6e0-773252aa68c3, identifier: LP50838
2026-03-29 20:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838
2026-03-29 20:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838
2026-03-29 20:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838 to the API
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:13Z',
 'fuel_type': 'diesel',
 'id': 'ef966229-e609-529e-b6e0-773252aa68c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP50838',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 130522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-29 20:35:33 [auto1.be] INFO: Saving data for LP50838: {'auction_closing_time': 1774884493.0, 'created_time': 1774730123.86855, 'last_price_update_time': 1774816533.069902}
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP50838') HTTP/1.1" 204 0
2026-03-29 20:35:33 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 20:35:33 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-29 20:35:33 [auto1.be] INFO: Scrape type for MW29844: 2
2026-03-29 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844
2026-03-29 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef602e6-fec7-5299-8276-c04dd95a404d with scrape type 2
2026-03-29 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ef602e6-fec7-5299-8276-c04dd95a404d with scrape type 2
2026-03-29 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ef602e6-fec7-5299-8276-c04dd95a404d, identifier: MW29844
2026-03-29 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844
2026-03-29 20:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844
2026-03-29 20:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844 to the API
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:17Z',
 'fuel_type': 'petrol',
 'id': '6ef602e6-fec7-5299-8276-c04dd95a404d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW29844',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-29 20:35:33 [auto1.be] INFO: Saving data for MW29844: {'auction_closing_time': 1774883957.0, 'created_time': 1774730122.740303, 'last_price_update_time': 1774816533.452348}
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW29844') HTTP/1.1" 204 0
2026-03-29 20:35:33 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-29 20:35:33 [auto1.be] INFO: Scrape type for FH45476: 2
2026-03-29 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476
2026-03-29 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with scrape type 2
2026-03-29 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with scrape type 2
2026-03-29 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74, identifier: FH45476
2026-03-29 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476
2026-03-29 20:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476
2026-03-29 20:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476 to the API
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:20:45Z',
 'fuel_type': 'diesel',
 'id': '2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH45476',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 120107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L1 Premium',
 'transmission': 'manual',
 'trim': 'L1 Premium',
 'year': 2019}
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-29 20:35:33 [auto1.be] INFO: Saving data for FH45476: {'auction_closing_time': 1774884045.0, 'created_time': 1774002088.816671, 'last_price_update_time': 1774816533.824088}
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH45476') HTTP/1.1" 204 0
2026-03-29 20:35:33 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-29 20:35:33 [auto1.be] INFO: Scrape type for NP55006: 2
2026-03-29 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006
2026-03-29 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70dbc77-ea9e-553a-94c2-117cbcf57417 with scrape type 2
2026-03-29 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b70dbc77-ea9e-553a-94c2-117cbcf57417 with scrape type 2
2026-03-29 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b70dbc77-ea9e-553a-94c2-117cbcf57417, identifier: NP55006
2026-03-29 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006
2026-03-29 20:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006
2026-03-29 20:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006 to the API
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:50:37Z',
 'fuel_type': 'diesel',
 'id': 'b70dbc77-ea9e-553a-94c2-117cbcf57417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP55006',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 57968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-12',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L3',
 'transmission': 'automatic',
 'trim': 'Allure L3',
 'year': 2021}
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-29 20:35:34 [auto1.be] INFO: Saving data for NP55006: {'auction_closing_time': 1774885837.0, 'created_time': 1774730124.180093, 'last_price_update_time': 1774816534.193037}
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP55006') HTTP/1.1" 204 0
2026-03-29 20:35:34 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 20:35:34 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-29 20:35:34 [auto1.be] INFO: Scrape type for DP40243: 2
2026-03-29 20:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243
2026-03-29 20:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8121c96f-5838-51e1-b6df-06eb6aee6b9a with scrape type 2
2026-03-29 20:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8121c96f-5838-51e1-b6df-06eb6aee6b9a with scrape type 2
2026-03-29 20:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8121c96f-5838-51e1-b6df-06eb6aee6b9a, identifier: DP40243
2026-03-29 20:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243
2026-03-29 20:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243
2026-03-29 20:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243 to the API
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:43:34Z',
 'fuel_type': 'diesel',
 'id': '8121c96f-5838-51e1-b6df-06eb6aee6b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP40243',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 334004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-29',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-29 20:35:34 [auto1.be] INFO: Saving data for DP40243: {'auction_closing_time': 1774885414.0, 'created_time': 1774730126.172038, 'last_price_update_time': 1774816534.573199}
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP40243') HTTP/1.1" 204 0
2026-03-29 20:35:34 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-29 20:35:34 [auto1.be] INFO: Scrape type for BR63185: 2
2026-03-29 20:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185
2026-03-29 20:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458ef8a1-c528-5088-a34d-7649fd7a2144 with scrape type 2
2026-03-29 20:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458ef8a1-c528-5088-a34d-7649fd7a2144 with scrape type 2
2026-03-29 20:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 458ef8a1-c528-5088-a34d-7649fd7a2144, identifier: BR63185
2026-03-29 20:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185
2026-03-29 20:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185
2026-03-29 20:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185 to the API
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': '458ef8a1-c528-5088-a34d-7649fd7a2144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR63185',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 234607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-29 20:35:35 [auto1.be] INFO: Saving data for BR63185: {'auction_closing_time': 1774882938.0, 'created_time': 1774730126.792845, 'last_price_update_time': 1774816535.050842}
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR63185') HTTP/1.1" 204 0
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-29 20:35:35 [auto1.be] INFO: Scrape type for AK19302: 2
2026-03-29 20:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302
2026-03-29 20:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with scrape type 2
2026-03-29 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with scrape type 2
2026-03-29 20:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d, identifier: AK19302
2026-03-29 20:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302
2026-03-29 20:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302
2026-03-29 20:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302 to the API
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:03:01Z',
 'fuel_type': 'diesel',
 'id': '5b4f0fbb-756d-5ded-ac2f-11491a821a6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK19302',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 428932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-11',
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Grand Edition 25th',
 'transmission': 'manual',
 'trim': 'Grand Edition 25th',
 'year': 2010}
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-29 20:35:35 [auto1.be] INFO: Saving data for AK19302: {'auction_closing_time': 1774882981.0, 'created_time': 1774730129.587781, 'last_price_update_time': 1774816535.448826}
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK19302') HTTP/1.1" 204 0
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 20:35:35 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-29 20:35:35 [auto1.be] INFO: Scrape type for NR82041: 2
2026-03-29 20:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041
2026-03-29 20:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55094067-9dae-5906-9e44-829836aca38b with scrape type 2
2026-03-29 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55094067-9dae-5906-9e44-829836aca38b with scrape type 2
2026-03-29 20:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55094067-9dae-5906-9e44-829836aca38b, identifier: NR82041
2026-03-29 20:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041
2026-03-29 20:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041
2026-03-29 20:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041 to the API
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:08:29Z',
 'fuel_type': 'petrol',
 'id': '55094067-9dae-5906-9e44-829836aca38b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR82041',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 5288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 200 Final Edition AMG Line',
 'transmission': 'automatic',
 'trim': 'Final Edition AMG Line',
 'year': 2020}
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-29 20:35:35 [auto1.be] INFO: Saving data for NR82041: {'auction_closing_time': 1774883309.0, 'created_time': 1774730128.156891, 'last_price_update_time': 1774816535.811324}
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NR82041') HTTP/1.1" 204 0
2026-03-29 20:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:43 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Scrape type for YW61664: 2
2026-03-29 20:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664
2026-03-29 20:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3128da6-d32b-5e75-9c67-d4977c4fbca4 with scrape type 2
2026-03-29 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3128da6-d32b-5e75-9c67-d4977c4fbca4 with scrape type 2
2026-03-29 20:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3128da6-d32b-5e75-9c67-d4977c4fbca4, identifier: YW61664
2026-03-29 20:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664
2026-03-29 20:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664
2026-03-29 20:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664 to the API
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:16:14Z',
 'fuel_type': 'diesel',
 'id': 'e3128da6-d32b-5e75-9c67-d4977c4fbca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW61664',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Terrano',
 'odometer': 218638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-22',
 'seller_name': None,
 'title': 'Nissan Terrano 3.0 TD Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-29 20:35:43 [auto1.be] INFO: Saving data for YW61664: {'auction_closing_time': 1774883774.0, 'created_time': 1774125450.165764, 'last_price_update_time': 1774816543.974599}
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW61664') HTTP/1.1" 204 0
2026-03-29 20:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 20:35:43 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-29 20:35:44 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-29 20:35:44 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-29 20:35:44 [auto1.be] INFO: Scrape type for BT09121: 2
2026-03-29 20:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121
2026-03-29 20:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8659b4a-f50a-5269-8889-c4611628566b with scrape type 2
2026-03-29 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8659b4a-f50a-5269-8889-c4611628566b with scrape type 2
2026-03-29 20:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8659b4a-f50a-5269-8889-c4611628566b, identifier: BT09121
2026-03-29 20:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121
2026-03-29 20:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121
2026-03-29 20:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121 to the API
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:13Z',
 'fuel_type': 'petrol',
 'id': 'd8659b4a-f50a-5269-8889-c4611628566b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT09121',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 71492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2017}
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-29 20:35:44 [auto1.be] INFO: Saving data for BT09121: {'auction_closing_time': 1774885993.0, 'created_time': 1774514143.293789, 'last_price_update_time': 1774816544.457482}
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT09121') HTTP/1.1" 204 0
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-29 20:35:44 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-29 20:35:44 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-29 20:35:44 [auto1.be] INFO: Scrape type for KX60472: 2
2026-03-29 20:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-29 20:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f9931b-e043-58de-a6a3-ac39d976e4dd with scrape type 2
2026-03-29 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f9931b-e043-58de-a6a3-ac39d976e4dd with scrape type 2
2026-03-29 20:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a7f9931b-e043-58de-a6a3-ac39d976e4dd, identifier: KX60472
2026-03-29 20:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 20:35:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 20:35:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-29 20:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472 to the API
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:34:59Z',
 'fuel_type': 'hybrid',
 'id': 'a7f9931b-e043-58de-a6a3-ac39d976e4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX60472',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 106875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-29 20:35:45 [auto1.be] INFO: Saving data for KX60472: {'auction_closing_time': 1774884899.0, 'created_time': 1773866331.134586, 'last_price_update_time': 1774816545.197674}
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX60472') HTTP/1.1" 204 0
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-29 20:35:45 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-29 20:35:45 [auto1.be] INFO: Scrape type for HW95173: 2
2026-03-29 20:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-29 20:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with scrape type 2
2026-03-29 20:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with scrape type 2
2026-03-29 20:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa, identifier: HW95173
2026-03-29 20:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-29 20:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-29 20:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173 to the API
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:33Z',
 'fuel_type': 'petrol',
 'id': '0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW95173',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 258602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-12',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2011}
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-29 20:35:45 [auto1.be] INFO: Saving data for HW95173: {'auction_closing_time': 1774885293.0, 'created_time': 1774524987.687508, 'last_price_update_time': 1774816545.585723}
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW95173') HTTP/1.1" 204 0
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-29 20:35:45 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-29 20:35:45 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-29 20:35:45 [auto1.be] INFO: Scrape type for HY77866: 2
2026-03-29 20:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-29 20:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c36cbd77-692c-5182-ad19-5eaa5a51c369 with scrape type 2
2026-03-29 20:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c36cbd77-692c-5182-ad19-5eaa5a51c369 with scrape type 2
2026-03-29 20:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c36cbd77-692c-5182-ad19-5eaa5a51c369, identifier: HY77866
2026-03-29 20:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-29 20:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-29 20:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866 to the API
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'diesel',
 'id': 'c36cbd77-692c-5182-ad19-5eaa5a51c369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY77866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 335380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Saving data for HY77866: {'auction_closing_time': 1774884518.0, 'created_time': 1773301748.141352, 'last_price_update_time': 1774816546.088933}
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY77866') HTTP/1.1" 204 0
2026-03-29 20:35:46 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Scrape type for CT30439: 2
2026-03-29 20:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-29 20:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42425bea-9115-5bff-9500-4f498b2837f6 with scrape type 2
2026-03-29 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42425bea-9115-5bff-9500-4f498b2837f6 with scrape type 2
2026-03-29 20:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42425bea-9115-5bff-9500-4f498b2837f6, identifier: CT30439
2026-03-29 20:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-29 20:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-29 20:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439 to the API
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:31Z',
 'fuel_type': 'petrol',
 'id': '42425bea-9115-5bff-9500-4f498b2837f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT30439',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 118676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Saving data for CT30439: {'auction_closing_time': 1774884571.0, 'created_time': 1774524932.663709, 'last_price_update_time': 1774816546.468709}
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CT30439') HTTP/1.1" 204 0
2026-03-29 20:35:46 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 20:35:46 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-29 20:35:46 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Scrape type for RK79502: 2
2026-03-29 20:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-29 20:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0d9d002-654d-51b1-a14f-04cb76d69395 with scrape type 2
2026-03-29 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0d9d002-654d-51b1-a14f-04cb76d69395 with scrape type 2
2026-03-29 20:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0d9d002-654d-51b1-a14f-04cb76d69395, identifier: RK79502
2026-03-29 20:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-29 20:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-29 20:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502 to the API
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:52:04Z',
 'fuel_type': 'petrol',
 'id': 'a0d9d002-654d-51b1-a14f-04cb76d69395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK79502',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 60315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Saving data for RK79502: {'auction_closing_time': 1774885924.0, 'created_time': 1774611389.445167, 'last_price_update_time': 1774816546.941796}
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK79502') HTTP/1.1" 204 0
2026-03-29 20:35:46 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-29 20:35:46 [auto1.be] INFO: Scrape type for RK12486: 2
2026-03-29 20:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-29 20:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with scrape type 2
2026-03-29 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with scrape type 2
2026-03-29 20:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a3bb856-96e4-574e-91fa-fa2220a9ea70, identifier: RK12486
2026-03-29 20:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-29 20:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-29 20:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486 to the API
2026-03-29 20:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:25Z',
 'fuel_type': 'diesel',
 'id': '5a3bb856-96e4-574e-91fa-fa2220a9ea70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12486',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 231164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2013}
2026-03-29 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-29 20:35:47 [auto1.be] INFO: Saving data for RK12486: {'auction_closing_time': 1774883485.0, 'created_time': 1774524942.120289, 'last_price_update_time': 1774816547.335668}
2026-03-29 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK12486') HTTP/1.1" 204 0
2026-03-29 20:35:47 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 20:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:48 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:48 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 20:35:48 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-29 20:35:48 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-29 20:35:48 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 20:35:48 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-29 20:35:48 [auto1.be] INFO: Scrape type for LH25651: 2
2026-03-29 20:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-29 20:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9aa645-1b32-55df-a761-c8a57744de08 with scrape type 2
2026-03-29 20:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9aa645-1b32-55df-a761-c8a57744de08 with scrape type 2
2026-03-29 20:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e9aa645-1b32-55df-a761-c8a57744de08, identifier: LH25651
2026-03-29 20:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-29 20:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-29 20:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651 to the API
2026-03-29 20:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:03:11Z',
 'fuel_type': 'diesel',
 'id': '2e9aa645-1b32-55df-a761-c8a57744de08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH25651',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 250339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'manual',
 'trim': 'Standard',
 'year': 2009}
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Saving data for LH25651: {'auction_closing_time': 1774882991.0, 'created_time': 1773747602.992207, 'last_price_update_time': 1774816549.355722}
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH25651') HTTP/1.1" 204 0
2026-03-29 20:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Scrape type for VM12927: 2
2026-03-29 20:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-29 20:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with scrape type 2
2026-03-29 20:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with scrape type 2
2026-03-29 20:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77ff12a-c863-558f-a8b3-18a5a93cc3c5, identifier: VM12927
2026-03-29 20:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-29 20:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-29 20:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927 to the API
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:32:04Z',
 'fuel_type': 'hybrid',
 'id': 'b77ff12a-c863-558f-a8b3-18a5a93cc3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM12927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 258698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Saving data for VM12927: {'auction_closing_time': 1774884724.0, 'created_time': 1773780048.69132, 'last_price_update_time': 1774816549.860736}
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM12927') HTTP/1.1" 204 0
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 20:35:49 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-29 20:35:49 [auto1.be] INFO: Scrape type for NB03494: 2
2026-03-29 20:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-29 20:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab4edf-e363-585d-904a-7f498841c1d9 with scrape type 2
2026-03-29 20:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab4edf-e363-585d-904a-7f498841c1d9 with scrape type 2
2026-03-29 20:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0ab4edf-e363-585d-904a-7f498841c1d9, identifier: NB03494
2026-03-29 20:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-29 20:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-29 20:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494 to the API
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:51:27Z',
 'fuel_type': 'petrol',
 'id': 'c0ab4edf-e363-585d-904a-7f498841c1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB03494',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 40166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-29 20:35:50 [auto1.be] INFO: Saving data for NB03494: {'auction_closing_time': 1774885887.0, 'created_time': 1773693675.093387, 'last_price_update_time': 1774816550.331982}
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB03494') HTTP/1.1" 204 0
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-29 20:35:50 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-29 20:35:50 [auto1.be] INFO: Scrape type for ZL62218: 2
2026-03-29 20:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218
2026-03-29 20:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0afc726-a3d4-560b-8a8b-2eaf6928a67a with scrape type 2
2026-03-29 20:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0afc726-a3d4-560b-8a8b-2eaf6928a67a with scrape type 2
2026-03-29 20:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0afc726-a3d4-560b-8a8b-2eaf6928a67a, identifier: ZL62218
2026-03-29 20:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218
2026-03-29 20:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218
2026-03-29 20:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218 to the API
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:28Z',
 'fuel_type': 'diesel',
 'id': 'b0afc726-a3d4-560b-8a8b-2eaf6928a67a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL62218',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 95643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Mazda 3 1.5 Diesel Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2017}
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-29 20:35:50 [auto1.be] INFO: Saving data for ZL62218: {'auction_closing_time': 1774882828.0, 'created_time': 1774730139.490723, 'last_price_update_time': 1774816550.812024}
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL62218') HTTP/1.1" 204 0
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-29 20:35:50 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 20:35:50 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-29 20:35:50 [auto1.be] INFO: Scrape type for EL84394: 2
2026-03-29 20:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-29 20:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with scrape type 2
2026-03-29 20:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with scrape type 2
2026-03-29 20:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8, identifier: EL84394
2026-03-29 20:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-29 20:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-29 20:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394 to the API
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:22Z',
 'fuel_type': 'diesel',
 'id': '6af9df9e-805c-593d-b9c7-94b4a8aff7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL84394',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 203556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-13',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2012}
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-29 20:35:51 [auto1.be] INFO: Saving data for EL84394: {'auction_closing_time': 1774883842.0, 'created_time': 1774298369.62793, 'last_price_update_time': 1774816551.347348}
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL84394') HTTP/1.1" 204 0
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-29 20:35:51 [auto1.be] INFO: Scrape type for WG23357: 2
2026-03-29 20:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-29 20:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06598ae-29da-5344-879a-d1331dcc094f with scrape type 2
2026-03-29 20:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c06598ae-29da-5344-879a-d1331dcc094f with scrape type 2
2026-03-29 20:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c06598ae-29da-5344-879a-d1331dcc094f, identifier: WG23357
2026-03-29 20:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-29 20:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-29 20:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357 to the API
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'petrol',
 'id': 'c06598ae-29da-5344-879a-d1331dcc094f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG23357',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 11155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-17',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 Mild-Hybrid Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-29 20:35:51 [auto1.be] INFO: Saving data for WG23357: {'auction_closing_time': 1774884355.0, 'created_time': 1774611323.485967, 'last_price_update_time': 1774816551.753702}
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG23357') HTTP/1.1" 204 0
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-29 20:35:51 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-29 20:35:51 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-29 20:35:51 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-29 20:35:51 [auto1.be] INFO: Scrape type for EV46077: 2
2026-03-29 20:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-29 20:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c460296-1576-59d0-8fcf-26a714b03f68 with scrape type 2
2026-03-29 20:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c460296-1576-59d0-8fcf-26a714b03f68 with scrape type 2
2026-03-29 20:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c460296-1576-59d0-8fcf-26a714b03f68, identifier: EV46077
2026-03-29 20:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-29 20:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-29 20:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077 to the API
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:50:52Z',
 'fuel_type': 'petrol',
 'id': '4c460296-1576-59d0-8fcf-26a714b03f68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV46077',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Saving data for EV46077: {'auction_closing_time': 1774885852.0, 'created_time': 1774524991.51853, 'last_price_update_time': 1774816552.180669}
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV46077') HTTP/1.1" 204 0
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Scrape type for GR79063: 2
2026-03-29 20:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-29 20:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0faee88b-dade-52f1-934c-ab2f9f671d2b with scrape type 2
2026-03-29 20:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0faee88b-dade-52f1-934c-ab2f9f671d2b with scrape type 2
2026-03-29 20:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0faee88b-dade-52f1-934c-ab2f9f671d2b, identifier: GR79063
2026-03-29 20:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-29 20:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-29 20:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063 to the API
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:30:27Z',
 'fuel_type': 'diesel',
 'id': '0faee88b-dade-52f1-934c-ab2f9f671d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR79063',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 141474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-19',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Business Eco2',
 'transmission': 'manual',
 'trim': 'Business Eco2',
 'year': 2015}
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Saving data for GR79063: {'auction_closing_time': 1774884627.0, 'created_time': 1774524980.412381, 'last_price_update_time': 1774816552.653048}
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR79063') HTTP/1.1" 204 0
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-29 20:35:52 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-29 20:35:52 [auto1.be] INFO: Scrape type for JW06840: 2
2026-03-29 20:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840
2026-03-29 20:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a56e16-7835-58e3-8a1a-70b89c9f0910 with scrape type 2
2026-03-29 20:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a56e16-7835-58e3-8a1a-70b89c9f0910 with scrape type 2
2026-03-29 20:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9a56e16-7835-58e3-8a1a-70b89c9f0910, identifier: JW06840
2026-03-29 20:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840
2026-03-29 20:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840
2026-03-29 20:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840 to the API
2026-03-29 20:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:33:35Z',
 'fuel_type': 'diesel',
 'id': 'b9a56e16-7835-58e3-8a1a-70b89c9f0910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW06840',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 136703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-29 20:35:53 [auto1.be] INFO: Saving data for JW06840: {'auction_closing_time': 1774884815.0, 'created_time': 1774514156.644548, 'last_price_update_time': 1774816553.13414}
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW06840') HTTP/1.1" 204 0
2026-03-29 20:35:53 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-29 20:35:53 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-29 20:35:53 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 20:35:53 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-29 20:35:53 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-29 20:35:53 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 20:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:35:59 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1260 | hits on page: 40
2026-03-29 20:35:59 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 20:35:59 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-29 20:35:59 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-29 20:35:59 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 20:35:59 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-29 20:35:59 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-29 20:35:59 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-29 20:35:59 [auto1.be] INFO: Scrape type for HD23270: 2
2026-03-29 20:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270
2026-03-29 20:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9669648d-294f-5a82-937e-ec50254d4d0b with scrape type 2
2026-03-29 20:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9669648d-294f-5a82-937e-ec50254d4d0b with scrape type 2
2026-03-29 20:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9669648d-294f-5a82-937e-ec50254d4d0b, identifier: HD23270
2026-03-29 20:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270
2026-03-29 20:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270
2026-03-29 20:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270 to the API
2026-03-29 20:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:38:05Z',
 'fuel_type': 'petrol',
 'id': '9669648d-294f-5a82-937e-ec50254d4d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD23270',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 107408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-29 20:36:00 [auto1.be] INFO: Saving data for HD23270: {'auction_closing_time': 1774885085.0, 'created_time': 1774514139.893756, 'last_price_update_time': 1774816560.847824}
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HD23270') HTTP/1.1" 204 0
2026-03-29 20:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-29 20:36:00 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 20:36:00 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-29 20:36:00 [auto1.be] INFO: Scrape type for JV18684: 2
2026-03-29 20:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-29 20:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18444be-aa2a-5ae1-b98e-e7994396df86 with scrape type 2
2026-03-29 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e18444be-aa2a-5ae1-b98e-e7994396df86 with scrape type 2
2026-03-29 20:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e18444be-aa2a-5ae1-b98e-e7994396df86, identifier: JV18684
2026-03-29 20:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 20:36:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-29 20:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684 to the API
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:32Z',
 'fuel_type': 'diesel',
 'id': 'e18444be-aa2a-5ae1-b98e-e7994396df86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV18684',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 196540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-08',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-29 20:36:01 [auto1.be] INFO: Saving data for JV18684: {'auction_closing_time': 1774883972.0, 'created_time': 1774611356.279584, 'last_price_update_time': 1774816561.909909}
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV18684') HTTP/1.1" 204 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for RY85405: 2
2026-03-29 20:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-29 20:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f308b866-e519-553c-bdb7-b407ae95e0a3 with scrape type 2
2026-03-29 20:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f308b866-e519-553c-bdb7-b407ae95e0a3 with scrape type 2
2026-03-29 20:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f308b866-e519-553c-bdb7-b407ae95e0a3, identifier: RY85405
2026-03-29 20:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-29 20:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-29 20:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405 to the API
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:01:07Z',
 'fuel_type': 'diesel',
 'id': 'f308b866-e519-553c-bdb7-b407ae95e0a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY85405',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Saving data for RY85405: {'auction_closing_time': 1774882867.0, 'created_time': 1774524985.470521, 'last_price_update_time': 1774816562.366364}
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY85405') HTTP/1.1" 204 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for BT94428: 2
2026-03-29 20:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-29 20:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with scrape type 2
2026-03-29 20:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with scrape type 2
2026-03-29 20:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60, identifier: BT94428
2026-03-29 20:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-29 20:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-29 20:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428 to the API
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-30T15:53:06Z',
 'fuel_type': 'hybrid',
 'id': 'a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT94428',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 164578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription Expression 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2020}
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Saving data for BT94428: {'auction_closing_time': 1774885986.0, 'created_time': 1774524935.464035, 'last_price_update_time': 1774816562.842933}
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT94428') HTTP/1.1" 204 0
2026-03-29 20:36:02 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-29 20:36:02 [auto1.be] INFO: Scrape type for WC55286: 2
2026-03-29 20:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-29 20:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e465e6fd-fb29-5377-a170-172043a7b3bc with scrape type 2
2026-03-29 20:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e465e6fd-fb29-5377-a170-172043a7b3bc with scrape type 2
2026-03-29 20:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e465e6fd-fb29-5377-a170-172043a7b3bc, identifier: WC55286
2026-03-29 20:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-29 20:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-29 20:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286 to the API
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:29:50Z',
 'fuel_type': 'diesel',
 'id': 'e465e6fd-fb29-5377-a170-172043a7b3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC55286',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 215455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-22',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-29 20:36:03 [auto1.be] INFO: Saving data for WC55286: {'auction_closing_time': 1774884590.0, 'created_time': 1774524944.983296, 'last_price_update_time': 1774816563.309859}
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC55286') HTTP/1.1" 204 0
2026-03-29 20:36:03 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 20:36:03 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 20:36:03 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 20:36:03 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-29 20:36:03 [auto1.be] INFO: Scrape type for MG81689: 2
2026-03-29 20:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-29 20:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with scrape type 2
2026-03-29 20:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with scrape type 2
2026-03-29 20:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c, identifier: MG81689
2026-03-29 20:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-29 20:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-29 20:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689 to the API
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:16Z',
 'fuel_type': 'petrol',
 'id': 'cfe4be9f-131e-5380-a3ba-1ca82ec2e80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81689',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 114137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'Renault Clio 1.6 Night and Day',
 'transmission': 'automatic',
 'trim': 'Night and Day',
 'year': 2012}
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-29 20:36:03 [auto1.be] INFO: Saving data for MG81689: {'auction_closing_time': 1774884076.0, 'created_time': 1774524968.056158, 'last_price_update_time': 1774816563.697212}
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG81689') HTTP/1.1" 204 0
2026-03-29 20:36:03 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 20:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:04 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:04 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 20:36:04 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 20:36:04 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-29 20:36:04 [auto1.be] INFO: Scrape type for ZL15279: 2
2026-03-29 20:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-29 20:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with scrape type 2
2026-03-29 20:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with scrape type 2
2026-03-29 20:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d, identifier: ZL15279
2026-03-29 20:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-29 20:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-29 20:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279 to the API
2026-03-29 20:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:23:27Z',
 'fuel_type': 'diesel',
 'id': 'ab0c8d4c-afc1-593f-bba2-4af7d0e2812d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15279',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 242853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-29 20:36:05 [auto1.be] INFO: Saving data for ZL15279: {'auction_closing_time': 1774884207.0, 'created_time': 1773909333.908026, 'last_price_update_time': 1774816565.04278}
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL15279') HTTP/1.1" 204 0
2026-03-29 20:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-29 20:36:05 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-29 20:36:05 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-29 20:36:05 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-29 20:36:05 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-29 20:36:05 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-29 20:36:05 [auto1.be] INFO: Scrape type for NN42853: 2
2026-03-29 20:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-29 20:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with scrape type 2
2026-03-29 20:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with scrape type 2
2026-03-29 20:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3a8f7bf-03be-59d5-8042-8d30f99dccb1, identifier: NN42853
2026-03-29 20:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-29 20:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-29 20:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853 to the API
2026-03-29 20:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:01:05Z',
 'fuel_type': 'petrol',
 'id': 'd3a8f7bf-03be-59d5-8042-8d30f99dccb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN42853',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 44541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Creative',
 'transmission': 'automatic',
 'trim': 'Creative',
 'year': 2022}
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Saving data for NN42853: {'auction_closing_time': 1774882865.0, 'created_time': 1774524941.213103, 'last_price_update_time': 1774816566.279961}
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN42853') HTTP/1.1" 204 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for BU27000: 2
2026-03-29 20:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-29 20:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25410665-1619-5ac3-bdfa-bb2c02232e4b with scrape type 2
2026-03-29 20:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25410665-1619-5ac3-bdfa-bb2c02232e4b with scrape type 2
2026-03-29 20:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25410665-1619-5ac3-bdfa-bb2c02232e4b, identifier: BU27000
2026-03-29 20:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-29 20:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-29 20:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000 to the API
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:48:36Z',
 'fuel_type': 'petrol',
 'id': '25410665-1619-5ac3-bdfa-bb2c02232e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU27000',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 111130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Opel Combo Life 1.2 Turbo Advance XL',
 'transmission': 'automatic',
 'trim': 'Advance XL',
 'year': 2020}
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Saving data for BU27000: {'auction_closing_time': 1774885716.0, 'created_time': 1774611336.608016, 'last_price_update_time': 1774816566.816581}
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU27000') HTTP/1.1" 204 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-29 20:36:06 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-29 20:36:06 [auto1.be] INFO: Scrape type for JA34397: 2
2026-03-29 20:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-29 20:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb with scrape type 2
2026-03-29 20:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb with scrape type 2
2026-03-29 20:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0920a71-39f6-5dac-87cb-fb128e3d8cbb, identifier: JA34397
2026-03-29 20:36:07 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 13 pages/min), scraped 45 items (at 45 items/min)
2026-03-29 20:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 20:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-29 20:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-29 20:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397 to the API
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:08Z',
 'fuel_type': 'petrol',
 'id': 'c0920a71-39f6-5dac-87cb-fb128e3d8cbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA34397',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 126696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-29 20:36:07 [auto1.be] INFO: Saving data for JA34397: {'auction_closing_time': 1774884248.0, 'created_time': 1774611399.55852, 'last_price_update_time': 1774816567.330301}
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JA34397') HTTP/1.1" 204 0
2026-03-29 20:36:07 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-29 20:36:07 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-29 20:36:07 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 20:36:07 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-29 20:36:07 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-29 20:36:07 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 20:36:07 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-29 20:36:07 [auto1.be] INFO: Scrape type for BJ27729: 2
2026-03-29 20:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-29 20:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de489c1d-4dfa-5d64-b378-4f9773c807f9 with scrape type 2
2026-03-29 20:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de489c1d-4dfa-5d64-b378-4f9773c807f9 with scrape type 2
2026-03-29 20:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de489c1d-4dfa-5d64-b378-4f9773c807f9, identifier: BJ27729
2026-03-29 20:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-29 20:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-29 20:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729 to the API
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:40Z',
 'fuel_type': 'petrol',
 'id': 'de489c1d-4dfa-5d64-b378-4f9773c807f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ27729',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 10113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-29 20:36:07 [auto1.be] INFO: Saving data for BJ27729: {'auction_closing_time': 1774884160.0, 'created_time': 1773866678.747124, 'last_price_update_time': 1774816567.867149}
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ27729') HTTP/1.1" 204 0
2026-03-29 20:36:07 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-29 20:36:07 [auto1.be] INFO: Scrape type for EN18719: 2
2026-03-29 20:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-29 20:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb3bb49-6bda-583f-99a8-71d676921b5f with scrape type 2
2026-03-29 20:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cb3bb49-6bda-583f-99a8-71d676921b5f with scrape type 2
2026-03-29 20:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cb3bb49-6bda-583f-99a8-71d676921b5f, identifier: EN18719
2026-03-29 20:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-29 20:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-29 20:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719 to the API
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:43:26Z',
 'fuel_type': 'petrol',
 'id': '8cb3bb49-6bda-583f-99a8-71d676921b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN18719',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 108145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-29 20:36:08 [auto1.be] INFO: Saving data for EN18719: {'auction_closing_time': 1774885406.0, 'created_time': 1774611353.281007, 'last_price_update_time': 1774816568.279823}
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN18719') HTTP/1.1" 204 0
2026-03-29 20:36:08 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 20:36:08 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-29 20:36:08 [auto1.be] INFO: Scrape type for YM63500: 2
2026-03-29 20:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-29 20:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with scrape type 2
2026-03-29 20:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with scrape type 2
2026-03-29 20:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea, identifier: YM63500
2026-03-29 20:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-29 20:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-29 20:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500 to the API
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:07Z',
 'fuel_type': 'diesel',
 'id': '29f8fd09-4026-5a84-97ce-6a3bc50c58ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM63500',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 119815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 2WD',
 'transmission': 'manual',
 'trim': '2WD',
 'year': 2019}
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-29 20:36:08 [auto1.be] INFO: Saving data for YM63500: {'auction_closing_time': 1774884607.0, 'created_time': 1773384022.03285, 'last_price_update_time': 1774816568.664919}
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM63500') HTTP/1.1" 204 0
2026-03-29 20:36:08 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-29 20:36:08 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-29 20:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:08 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:08 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 20:36:08 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 20:36:08 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-29 20:36:08 [auto1.be] INFO: Scrape type for EM18277: 2
2026-03-29 20:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-29 20:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db494d34-2045-59d5-9f77-55413ffc9d5a with scrape type 2
2026-03-29 20:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db494d34-2045-59d5-9f77-55413ffc9d5a with scrape type 2
2026-03-29 20:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db494d34-2045-59d5-9f77-55413ffc9d5a, identifier: EM18277
2026-03-29 20:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-29 20:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-29 20:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277 to the API
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:14:13Z',
 'fuel_type': 'petrol',
 'id': 'db494d34-2045-59d5-9f77-55413ffc9d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM18277',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 59465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-04',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-29 20:36:09 [auto1.be] INFO: Saving data for EM18277: {'auction_closing_time': 1774883653.0, 'created_time': 1773693560.455665, 'last_price_update_time': 1774816569.210313}
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM18277') HTTP/1.1" 204 0
2026-03-29 20:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:09 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-29 20:36:09 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-29 20:36:09 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 20:36:09 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-29 20:36:09 [auto1.be] INFO: Scrape type for YW29468: 2
2026-03-29 20:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-29 20:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91452478-9f75-5f80-adf9-e9c228fd122a with scrape type 2
2026-03-29 20:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91452478-9f75-5f80-adf9-e9c228fd122a with scrape type 2
2026-03-29 20:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 91452478-9f75-5f80-adf9-e9c228fd122a, identifier: YW29468
2026-03-29 20:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-29 20:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-29 20:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468 to the API
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'diesel',
 'id': '91452478-9f75-5f80-adf9-e9c228fd122a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW29468',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 187363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2018}
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-29 20:36:09 [auto1.be] INFO: Saving data for YW29468: {'auction_closing_time': 1774884424.0, 'created_time': 1774524953.567365, 'last_price_update_time': 1774816569.679759}
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW29468') HTTP/1.1" 204 0
2026-03-29 20:36:09 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 20:36:09 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-29 20:36:09 [auto1.be] INFO: Scrape type for AS01915: 2
2026-03-29 20:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-29 20:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c40a051-92bd-537a-9140-d36f2ea9d85f with scrape type 2
2026-03-29 20:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c40a051-92bd-537a-9140-d36f2ea9d85f with scrape type 2
2026-03-29 20:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c40a051-92bd-537a-9140-d36f2ea9d85f, identifier: AS01915
2026-03-29 20:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-29 20:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-29 20:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915 to the API
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:40Z',
 'fuel_type': 'petrol',
 'id': '9c40a051-92bd-537a-9140-d36f2ea9d85f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS01915',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 93339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-09',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-29 20:36:10 [auto1.be] INFO: Saving data for AS01915: {'auction_closing_time': 1774885000.0, 'created_time': 1773650189.72292, 'last_price_update_time': 1774816570.086174}
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AS01915') HTTP/1.1" 204 0
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-29 20:36:10 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-29 20:36:10 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-29 20:36:10 [auto1.be] INFO: Scrape type for WA82695: 2
2026-03-29 20:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-29 20:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40829756-87ea-549d-9f2d-20fe2305b3cd with scrape type 2
2026-03-29 20:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40829756-87ea-549d-9f2d-20fe2305b3cd with scrape type 2
2026-03-29 20:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40829756-87ea-549d-9f2d-20fe2305b3cd, identifier: WA82695
2026-03-29 20:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-29 20:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-29 20:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695 to the API
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:21:14Z',
 'fuel_type': 'petrol',
 'id': '40829756-87ea-549d-9f2d-20fe2305b3cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA82695',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 172767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 THP Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2016}
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-29 20:36:10 [auto1.be] INFO: Saving data for WA82695: {'auction_closing_time': 1774884074.0, 'created_time': 1774643727.751686, 'last_price_update_time': 1774816570.487668}
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA82695') HTTP/1.1" 204 0
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 20:36:10 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-29 20:36:10 [auto1.be] INFO: Scrape type for AF68960: 2
2026-03-29 20:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960
2026-03-29 20:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with scrape type 2
2026-03-29 20:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with scrape type 2
2026-03-29 20:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d705c5e-83c1-5de2-aee8-f988ad5c0808, identifier: AF68960
2026-03-29 20:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960
2026-03-29 20:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960
2026-03-29 20:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960 to the API
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:22:02Z',
 'fuel_type': 'petrol',
 'id': '4d705c5e-83c1-5de2-aee8-f988ad5c0808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF68960',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 64276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Limited 4x2',
 'transmission': 'manual',
 'trim': 'Limited 4x2',
 'year': 2021}
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Saving data for AF68960: {'auction_closing_time': 1774884122.0, 'created_time': 1774514152.283316, 'last_price_update_time': 1774816571.039813}
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF68960') HTTP/1.1" 204 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for VU61418: 2
2026-03-29 20:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418
2026-03-29 20:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb52768-7a66-5781-8faa-9000dcb72b7d with scrape type 2
2026-03-29 20:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb52768-7a66-5781-8faa-9000dcb72b7d with scrape type 2
2026-03-29 20:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7cb52768-7a66-5781-8faa-9000dcb72b7d, identifier: VU61418
2026-03-29 20:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418
2026-03-29 20:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418
2026-03-29 20:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418 to the API
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:01Z',
 'fuel_type': 'diesel',
 'id': '7cb52768-7a66-5781-8faa-9000dcb72b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU61418',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 189477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-09',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Saving data for VU61418: {'auction_closing_time': 1774884121.0, 'created_time': 1774514148.180901, 'last_price_update_time': 1774816571.519573}
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU61418') HTTP/1.1" 204 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 20:36:11 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Scrape type for PP48497: 2
2026-03-29 20:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-29 20:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with scrape type 2
2026-03-29 20:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with scrape type 2
2026-03-29 20:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41, identifier: PP48497
2026-03-29 20:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-29 20:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-29 20:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497 to the API
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:44:54Z',
 'fuel_type': 'petrol',
 'id': '8cc6588e-a48a-5e8a-88e2-2b1f91922c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP48497',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 109933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2016}
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-29 20:36:11 [auto1.be] INFO: Saving data for PP48497: {'auction_closing_time': 1774885494.0, 'created_time': 1774524963.747881, 'last_price_update_time': 1774816571.951561}
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PP48497') HTTP/1.1" 204 0
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Scrape type for TU68669: 2
2026-03-29 20:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-29 20:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264d6f6f-4cd5-516c-b999-a468d4bea33b with scrape type 2
2026-03-29 20:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 264d6f6f-4cd5-516c-b999-a468d4bea33b with scrape type 2
2026-03-29 20:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 264d6f6f-4cd5-516c-b999-a468d4bea33b, identifier: TU68669
2026-03-29 20:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-29 20:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-29 20:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669 to the API
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:37:44Z',
 'fuel_type': 'diesel',
 'id': '264d6f6f-4cd5-516c-b999-a468d4bea33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU68669',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 157938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction ultra',
 'transmission': 'manual',
 'trim': 'Attraction ultra',
 'year': 2015}
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Saving data for TU68669: {'auction_closing_time': 1774885064.0, 'created_time': 1774611375.0683, 'last_price_update_time': 1774816572.556886}
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU68669') HTTP/1.1" 204 0
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Scrape type for PH64665: 2
2026-03-29 20:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-29 20:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be884f4-f70e-5d5b-8d2c-d41e539064fb with scrape type 2
2026-03-29 20:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be884f4-f70e-5d5b-8d2c-d41e539064fb with scrape type 2
2026-03-29 20:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9be884f4-f70e-5d5b-8d2c-d41e539064fb, identifier: PH64665
2026-03-29 20:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-29 20:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-29 20:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665 to the API
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'diesel',
 'id': '9be884f4-f70e-5d5b-8d2c-d41e539064fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH64665',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 277375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-04',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-29 20:36:12 [auto1.be] INFO: Saving data for PH64665: {'auction_closing_time': 1774886102.0, 'created_time': 1773693510.93278, 'last_price_update_time': 1774816572.980519}
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH64665') HTTP/1.1" 204 0
2026-03-29 20:36:12 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-29 20:36:13 [auto1.be] INFO: Scrape type for RH07818: 2
2026-03-29 20:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-29 20:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 with scrape type 2
2026-03-29 20:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 with scrape type 2
2026-03-29 20:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7dcc4989-0149-5316-9c9a-6d939d6638d9, identifier: RH07818
2026-03-29 20:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-29 20:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-29 20:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818 to the API
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:34Z',
 'fuel_type': 'petrol',
 'id': '7dcc4989-0149-5316-9c9a-6d939d6638d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH07818',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 92665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-29 20:36:13 [auto1.be] INFO: Saving data for RH07818: {'auction_closing_time': 1774885474.0, 'created_time': 1774611367.616486, 'last_price_update_time': 1774816573.377886}
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH07818') HTTP/1.1" 204 0
2026-03-29 20:36:13 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-29 20:36:13 [auto1.be] INFO: Scrape type for LT97220: 2
2026-03-29 20:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-29 20:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with scrape type 2
2026-03-29 20:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with scrape type 2
2026-03-29 20:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f, identifier: LT97220
2026-03-29 20:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-29 20:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-29 20:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220 to the API
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:51:20Z',
 'fuel_type': 'petrol',
 'id': '1b2bece5-3783-5852-bbc2-c53cfc6aea3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT97220',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 82658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-17',
 'seller_name': None,
 'title': 'Ford Fusion 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-29 20:36:13 [auto1.be] INFO: Saving data for LT97220: {'auction_closing_time': 1774885880.0, 'created_time': 1774524984.426966, 'last_price_update_time': 1774816573.856307}
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT97220') HTTP/1.1" 204 0
2026-03-29 20:36:13 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:13 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-29 20:36:13 [auto1.be] INFO: Scrape type for ML35155: 2
2026-03-29 20:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-29 20:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27431265-39ba-5c53-a9c2-ee1d17379273 with scrape type 2
2026-03-29 20:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27431265-39ba-5c53-a9c2-ee1d17379273 with scrape type 2
2026-03-29 20:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27431265-39ba-5c53-a9c2-ee1d17379273, identifier: ML35155
2026-03-29 20:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-29 20:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-29 20:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155 to the API
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:31Z',
 'fuel_type': 'diesel',
 'id': '27431265-39ba-5c53-a9c2-ee1d17379273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML35155',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 259006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-29 20:36:14 [auto1.be] INFO: Saving data for ML35155: {'auction_closing_time': 1774884391.0, 'created_time': 1774524991.884173, 'last_price_update_time': 1774816574.239786}
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML35155') HTTP/1.1" 204 0
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-29 20:36:14 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-29 20:36:14 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-29 20:36:14 [auto1.be] INFO: Scrape type for YV36261: 2
2026-03-29 20:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-29 20:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bbead9-acb7-5c85-b22c-dbea4f404194 with scrape type 2
2026-03-29 20:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bbead9-acb7-5c85-b22c-dbea4f404194 with scrape type 2
2026-03-29 20:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2bbead9-acb7-5c85-b22c-dbea4f404194, identifier: YV36261
2026-03-29 20:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-29 20:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-29 20:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261 to the API
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:20:06Z',
 'fuel_type': 'petrol',
 'id': 'b2bbead9-acb7-5c85-b22c-dbea4f404194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV36261',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 195767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2013}
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-29 20:36:14 [auto1.be] INFO: Saving data for YV36261: {'auction_closing_time': 1774884006.0, 'created_time': 1773866134.068108, 'last_price_update_time': 1774816574.691764}
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV36261') HTTP/1.1" 204 0
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 20:36:14 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-29 20:36:14 [auto1.be] INFO: Scrape type for NC04706: 2
2026-03-29 20:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-29 20:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with scrape type 2
2026-03-29 20:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with scrape type 2
2026-03-29 20:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c, identifier: NC04706
2026-03-29 20:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-29 20:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-29 20:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706 to the API
2026-03-29 20:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:56Z',
 'fuel_type': 'petrol',
 'id': '1a8552fe-0a7c-5d45-81b2-892f66bfb54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC04706',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 123913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-29 20:36:15 [auto1.be] INFO: Saving data for NC04706: {'auction_closing_time': 1774886216.0, 'created_time': 1774298376.631374, 'last_price_update_time': 1774816575.146836}
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC04706') HTTP/1.1" 204 0
2026-03-29 20:36:15 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-29 20:36:15 [auto1.be] INFO: Scrape type for CD06973: 2
2026-03-29 20:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973
2026-03-29 20:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with scrape type 2
2026-03-29 20:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with scrape type 2
2026-03-29 20:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ed41241-6f2e-5505-acbb-f32d30ffeab7, identifier: CD06973
2026-03-29 20:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973
2026-03-29 20:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973
2026-03-29 20:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973 to the API
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:03:05Z',
 'fuel_type': 'petrol',
 'id': '6ed41241-6f2e-5505-acbb-f32d30ffeab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD06973',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 188775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.0 Turbo Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2018}
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-29 20:36:15 [auto1.be] INFO: Saving data for CD06973: {'auction_closing_time': 1774882985.0, 'created_time': 1774514150.127178, 'last_price_update_time': 1774816575.555381}
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD06973') HTTP/1.1" 204 0
2026-03-29 20:36:15 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 20:36:15 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 20:36:15 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-29 20:36:15 [auto1.be] INFO: Scrape type for WP77061: 2
2026-03-29 20:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-29 20:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a147e50-aa18-5959-b2b8-28fea0ad92ba with scrape type 2
2026-03-29 20:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a147e50-aa18-5959-b2b8-28fea0ad92ba with scrape type 2
2026-03-29 20:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a147e50-aa18-5959-b2b8-28fea0ad92ba, identifier: WP77061
2026-03-29 20:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-29 20:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-29 20:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061 to the API
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:42:59Z',
 'fuel_type': 'petrol',
 'id': '8a147e50-aa18-5959-b2b8-28fea0ad92ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP77061',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 108707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seller_name': None,
 'title': 'Maserati Levante 2.0 Turbo Mild-Hybrid GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-29 20:36:15 [auto1.be] INFO: Saving data for WP77061: {'auction_closing_time': 1774885379.0, 'created_time': 1773747445.557384, 'last_price_update_time': 1774816575.967845}
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP77061') HTTP/1.1" 204 0
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Scrape type for TK93480: 2
2026-03-29 20:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-29 20:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with scrape type 2
2026-03-29 20:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with scrape type 2
2026-03-29 20:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba, identifier: TK93480
2026-03-29 20:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-29 20:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-29 20:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480 to the API
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'diesel',
 'id': '7d6d8759-6b2c-54ac-a9a5-f2967f224dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK93480',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 163254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-08',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Saving data for TK93480: {'auction_closing_time': 1774885292.0, 'created_time': 1774524925.555339, 'last_price_update_time': 1774816576.47431}
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK93480') HTTP/1.1" 204 0
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Scrape type for JJ10339: 2
2026-03-29 20:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-29 20:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81fff97d-7a98-5822-adca-eeab47b5c767 with scrape type 2
2026-03-29 20:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81fff97d-7a98-5822-adca-eeab47b5c767 with scrape type 2
2026-03-29 20:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81fff97d-7a98-5822-adca-eeab47b5c767, identifier: JJ10339
2026-03-29 20:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-29 20:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-29 20:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339 to the API
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'petrol',
 'id': '81fff97d-7a98-5822-adca-eeab47b5c767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ10339',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 52303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Suzuki SX4 1.4 BoosterJet Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2019}
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Saving data for JJ10339: {'auction_closing_time': 1774886369.0, 'created_time': 1773779728.658145, 'last_price_update_time': 1774816576.921527}
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ10339') HTTP/1.1" 204 0
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 20:36:16 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-29 20:36:16 [auto1.be] INFO: Scrape type for FV97066: 2
2026-03-29 20:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-29 20:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with scrape type 2
2026-03-29 20:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with scrape type 2
2026-03-29 20:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a, identifier: FV97066
2026-03-29 20:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-29 20:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-29 20:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066 to the API
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:03Z',
 'fuel_type': 'diesel',
 'id': 'fd805b55-1afb-5b07-be74-9ab9ca9b2d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV97066',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 127856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-15',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-29 20:36:17 [auto1.be] INFO: Saving data for FV97066: {'auction_closing_time': 1774885563.0, 'created_time': 1773866726.442018, 'last_price_update_time': 1774816577.603453}
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV97066') HTTP/1.1" 204 0
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-29 20:36:17 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-29 20:36:17 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-29 20:36:17 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-29 20:36:17 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-29 20:36:17 [auto1.be] INFO: Scrape type for SX32022: 2
2026-03-29 20:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-29 20:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e962ff3b-5daf-58c4-878a-679afeaf0974 with scrape type 2
2026-03-29 20:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e962ff3b-5daf-58c4-878a-679afeaf0974 with scrape type 2
2026-03-29 20:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e962ff3b-5daf-58c4-878a-679afeaf0974, identifier: SX32022
2026-03-29 20:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-29 20:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-29 20:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022 to the API
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:24:15Z',
 'fuel_type': 'petrol',
 'id': 'e962ff3b-5daf-58c4-878a-679afeaf0974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX32022',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 97443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-18',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Saving data for SX32022: {'auction_closing_time': 1774884255.0, 'created_time': 1773909325.798418, 'last_price_update_time': 1774816578.036666}
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX32022') HTTP/1.1" 204 0
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Scrape type for XC12599: 2
2026-03-29 20:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-29 20:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with scrape type 2
2026-03-29 20:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with scrape type 2
2026-03-29 20:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f, identifier: XC12599
2026-03-29 20:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-29 20:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-29 20:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599 to the API
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:53Z',
 'fuel_type': 'diesel',
 'id': 'a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC12599',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 287576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-29',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Saving data for XC12599: {'auction_closing_time': 1774885313.0, 'created_time': 1773223786.475416, 'last_price_update_time': 1774816578.804632}
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC12599') HTTP/1.1" 204 0
2026-03-29 20:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:18 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-29 20:36:18 [auto1.be] INFO: Scrape type for ZJ76170: 2
2026-03-29 20:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-29 20:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with scrape type 2
2026-03-29 20:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with scrape type 2
2026-03-29 20:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e, identifier: ZJ76170
2026-03-29 20:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-29 20:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-29 20:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170 to the API
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:20Z',
 'fuel_type': 'petrol',
 'id': '98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ76170',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 122576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-29 20:36:19 [auto1.be] INFO: Saving data for ZJ76170: {'auction_closing_time': 1774883540.0, 'created_time': 1774524964.609558, 'last_price_update_time': 1774816579.188623}
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ76170') HTTP/1.1" 204 0
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-29 20:36:19 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-29 20:36:19 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-29 20:36:19 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-29 20:36:19 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-29 20:36:19 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-29 20:36:19 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-29 20:36:19 [auto1.be] INFO: Scrape type for BB40778: 2
2026-03-29 20:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-29 20:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with scrape type 2
2026-03-29 20:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with scrape type 2
2026-03-29 20:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76258935-be0a-58f6-b7dd-814fc3f8f5d1, identifier: BB40778
2026-03-29 20:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-29 20:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-29 20:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778 to the API
2026-03-29 20:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:14Z',
 'fuel_type': 'petrol',
 'id': '76258935-be0a-58f6-b7dd-814fc3f8f5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB40778',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 174725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-29 20:36:20 [auto1.be] INFO: Saving data for BB40778: {'auction_closing_time': 1774883954.0, 'created_time': 1774611364.225911, 'last_price_update_time': 1774816580.315012}
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB40778') HTTP/1.1" 204 0
2026-03-29 20:36:20 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-29 20:36:20 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-29 20:36:20 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-29 20:36:20 [auto1.be] INFO: Scrape type for DK43204: 2
2026-03-29 20:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-29 20:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2107a4-633a-53da-93b0-31ec43c84d96 with scrape type 2
2026-03-29 20:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c2107a4-633a-53da-93b0-31ec43c84d96 with scrape type 2
2026-03-29 20:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c2107a4-633a-53da-93b0-31ec43c84d96, identifier: DK43204
2026-03-29 20:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-29 20:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-29 20:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204 to the API
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:29:00Z',
 'fuel_type': 'petrol',
 'id': '8c2107a4-633a-53da-93b0-31ec43c84d96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK43204',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 15318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2019}
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-29 20:36:20 [auto1.be] INFO: Saving data for DK43204: {'auction_closing_time': 1774884540.0, 'created_time': 1774298339.746073, 'last_price_update_time': 1774816580.84306}
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK43204') HTTP/1.1" 204 0
2026-03-29 20:36:20 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 20:36:20 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-29 20:36:20 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-29 20:36:20 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-29 20:36:20 [auto1.be] INFO: Scrape type for WG62431: 2
2026-03-29 20:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-29 20:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2958b0c5-2af7-5849-b74b-c3641fee5741 with scrape type 2
2026-03-29 20:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2958b0c5-2af7-5849-b74b-c3641fee5741 with scrape type 2
2026-03-29 20:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2958b0c5-2af7-5849-b74b-c3641fee5741, identifier: WG62431
2026-03-29 20:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-29 20:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-29 20:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431 to the API
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:55Z',
 'fuel_type': 'petrol',
 'id': '2958b0c5-2af7-5849-b74b-c3641fee5741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG62431',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 213486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-07',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-29 20:36:21 [auto1.be] INFO: Saving data for WG62431: {'auction_closing_time': 1774885555.0, 'created_time': 1774125510.73548, 'last_price_update_time': 1774816581.815431}
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG62431') HTTP/1.1" 204 0
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-29 20:36:21 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-29 20:36:21 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 20:36:21 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-29 20:36:21 [auto1.be] INFO: Scrape type for GH94077: 2
2026-03-29 20:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-29 20:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with scrape type 2
2026-03-29 20:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with scrape type 2
2026-03-29 20:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 273cc2a8-9f22-54ab-bed4-684f509ae1d4, identifier: GH94077
2026-03-29 20:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-29 20:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-29 20:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077 to the API
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:30:58Z',
 'fuel_type': 'diesel',
 'id': '273cc2a8-9f22-54ab-bed4-684f509ae1d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH94077',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 224435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'BMW 3er 335d xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2015}
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-29 20:36:22 [auto1.be] INFO: Saving data for GH94077: {'auction_closing_time': 1774884658.0, 'created_time': 1773693526.746469, 'last_price_update_time': 1774816582.296223}
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH94077') HTTP/1.1" 204 0
2026-03-29 20:36:22 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 20:36:22 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 20:36:22 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-29 20:36:22 [auto1.be] INFO: Scrape type for LU38585: 2
2026-03-29 20:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-29 20:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466d7955-e321-5c6f-9a00-6c3bbb48a33e with scrape type 2
2026-03-29 20:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466d7955-e321-5c6f-9a00-6c3bbb48a33e with scrape type 2
2026-03-29 20:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 466d7955-e321-5c6f-9a00-6c3bbb48a33e, identifier: LU38585
2026-03-29 20:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-29 20:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-29 20:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585 to the API
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:39:26Z',
 'fuel_type': 'petrol',
 'id': '466d7955-e321-5c6f-9a00-6c3bbb48a33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU38585',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-29 20:36:22 [auto1.be] INFO: Saving data for LU38585: {'auction_closing_time': 1774885166.0, 'created_time': 1773736534.981773, 'last_price_update_time': 1774816582.845541}
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LU38585') HTTP/1.1" 204 0
2026-03-29 20:36:22 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 20:36:22 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 20:36:22 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-29 20:36:22 [auto1.be] INFO: Scrape type for GJ23391: 2
2026-03-29 20:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-29 20:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85591b64-c2d3-5cb9-b784-f430dca1e622 with scrape type 2
2026-03-29 20:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85591b64-c2d3-5cb9-b784-f430dca1e622 with scrape type 2
2026-03-29 20:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 85591b64-c2d3-5cb9-b784-f430dca1e622, identifier: GJ23391
2026-03-29 20:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-29 20:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-29 20:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391 to the API
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:42Z',
 'fuel_type': 'diesel',
 'id': '85591b64-c2d3-5cb9-b784-f430dca1e622',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ23391',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 172410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.8 HDi Tendance 2WD',
 'transmission': 'manual',
 'trim': 'Tendance 2WD',
 'year': 2012}
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-29 20:36:23 [auto1.be] INFO: Saving data for GJ23391: {'auction_closing_time': 1774885902.0, 'created_time': 1774298344.268251, 'last_price_update_time': 1774816583.256664}
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ23391') HTTP/1.1" 204 0
2026-03-29 20:36:23 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-29 20:36:23 [auto1.be] INFO: Scrape type for VM57702: 2
2026-03-29 20:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-29 20:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with scrape type 2
2026-03-29 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with scrape type 2
2026-03-29 20:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5, identifier: VM57702
2026-03-29 20:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-29 20:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-29 20:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702 to the API
2026-03-29 20:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:22Z',
 'fuel_type': 'diesel',
 'id': '6380588a-75da-5a3b-8dbe-d2c83a6ea6b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM57702',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 289125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2018}
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Saving data for VM57702: {'auction_closing_time': 1774884022.0, 'created_time': 1774611320.76343, 'last_price_update_time': 1774816584.313458}
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM57702') HTTP/1.1" 204 0
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-29 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:24 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Scrape type for YN26679: 2
2026-03-29 20:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-29 20:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with scrape type 2
2026-03-29 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with scrape type 2
2026-03-29 20:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a, identifier: YN26679
2026-03-29 20:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-29 20:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-29 20:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679 to the API
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:35:50Z',
 'fuel_type': 'petrol',
 'id': '1fc9325a-8b8b-5139-b0a7-0ccf1445e31a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN26679',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 133185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-06',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2005}
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Saving data for YN26679: {'auction_closing_time': 1774884950.0, 'created_time': 1774524948.559891, 'last_price_update_time': 1774816584.864337}
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN26679') HTTP/1.1" 204 0
2026-03-29 20:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-29 20:36:24 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 20:36:24 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-29 20:36:25 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-29 20:36:25 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 20:36:25 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 20:36:25 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-29 20:36:25 [auto1.be] INFO: Scrape type for GG55355: 2
2026-03-29 20:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-29 20:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7bc5fe3-7a0a-591e-b851-acb764baf9fd with scrape type 2
2026-03-29 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7bc5fe3-7a0a-591e-b851-acb764baf9fd with scrape type 2
2026-03-29 20:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7bc5fe3-7a0a-591e-b851-acb764baf9fd, identifier: GG55355
2026-03-29 20:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-29 20:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-29 20:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355 to the API
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:54:06Z',
 'fuel_type': 'petrol',
 'id': 'd7bc5fe3-7a0a-591e-b851-acb764baf9fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG55355',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 75467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T3 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-29 20:36:25 [auto1.be] INFO: Saving data for GG55355: {'auction_closing_time': 1774886046.0, 'created_time': 1773779753.352337, 'last_price_update_time': 1774816585.807399}
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG55355') HTTP/1.1" 204 0
2026-03-29 20:36:25 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-29 20:36:25 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-29 20:36:25 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-29 20:36:25 [auto1.be] INFO: Scrape type for MP28046: 2
2026-03-29 20:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-29 20:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with scrape type 2
2026-03-29 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with scrape type 2
2026-03-29 20:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7, identifier: MP28046
2026-03-29 20:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-29 20:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-29 20:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046 to the API
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:45:43Z',
 'fuel_type': 'petrol',
 'id': '0eaaa256-18a7-52b9-ac7a-89014d3a4cb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP28046',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 76109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'automatic',
 'trim': 'Satellite',
 'year': 2011}
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Saving data for MP28046: {'auction_closing_time': 1774885543.0, 'created_time': 1774611363.885903, 'last_price_update_time': 1774816586.23596}
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MP28046') HTTP/1.1" 204 0
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Scrape type for EG19315: 2
2026-03-29 20:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-29 20:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77e8956-d519-58ae-ae3a-8a4acd615628 with scrape type 2
2026-03-29 20:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77e8956-d519-58ae-ae3a-8a4acd615628 with scrape type 2
2026-03-29 20:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77e8956-d519-58ae-ae3a-8a4acd615628, identifier: EG19315
2026-03-29 20:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-29 20:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-29 20:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315 to the API
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:07:08Z',
 'fuel_type': 'diesel',
 'id': 'b77e8956-d519-58ae-ae3a-8a4acd615628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG19315',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 127087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
 'transmission': 'manual',
 'trim': 'Driver M',
 'year': 2019}
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Saving data for EG19315: {'auction_closing_time': 1774883228.0, 'created_time': 1773866679.754294, 'last_price_update_time': 1774816586.692164}
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG19315') HTTP/1.1" 204 0
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-29 20:36:26 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-29 20:36:26 [auto1.be] INFO: Scrape type for KN88676: 2
2026-03-29 20:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-29 20:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35733f2-4263-517c-8003-1531b3a86137 with scrape type 2
2026-03-29 20:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35733f2-4263-517c-8003-1531b3a86137 with scrape type 2
2026-03-29 20:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b35733f2-4263-517c-8003-1531b3a86137, identifier: KN88676
2026-03-29 20:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-29 20:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-29 20:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676 to the API
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:19:55Z',
 'fuel_type': 'diesel',
 'id': 'b35733f2-4263-517c-8003-1531b3a86137',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN88676',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 206887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-29 20:36:27 [auto1.be] INFO: Saving data for KN88676: {'auction_closing_time': 1774883995.0, 'created_time': 1773136045.972491, 'last_price_update_time': 1774816587.232752}
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KN88676') HTTP/1.1" 204 0
2026-03-29 20:36:27 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 20:36:27 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 20:36:27 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 20:36:27 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 20:36:27 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-29 20:36:27 [auto1.be] INFO: Scrape type for CG84069: 2
2026-03-29 20:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-29 20:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with scrape type 2
2026-03-29 20:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with scrape type 2
2026-03-29 20:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d67f2ac4-30c7-5b28-8227-5bc9aae0f290, identifier: CG84069
2026-03-29 20:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-29 20:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-29 20:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069 to the API
2026-03-29 20:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:44:27Z',
 'fuel_type': 'diesel',
 'id': 'd67f2ac4-30c7-5b28-8227-5bc9aae0f290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG84069',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 123027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-02',
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.5 Blue-HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2019}
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-29 20:36:28 [auto1.be] INFO: Saving data for CG84069: {'auction_closing_time': 1774885467.0, 'created_time': 1773747335.363558, 'last_price_update_time': 1774816588.312249}
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG84069') HTTP/1.1" 204 0
2026-03-29 20:36:28 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 20:36:28 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 20:36:28 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 20:36:28 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 20:36:28 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-29 20:36:28 [auto1.be] INFO: Scrape type for HK81119: 2
2026-03-29 20:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-29 20:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bbbfff-6905-504b-a81b-7851df51f18e with scrape type 2
2026-03-29 20:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64bbbfff-6905-504b-a81b-7851df51f18e with scrape type 2
2026-03-29 20:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64bbbfff-6905-504b-a81b-7851df51f18e, identifier: HK81119
2026-03-29 20:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-29 20:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-29 20:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119 to the API
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': '64bbbfff-6905-504b-a81b-7851df51f18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK81119',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Edition Standard',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Edition Standard',
 'year': 2017}
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-29 20:36:28 [auto1.be] INFO: Saving data for HK81119: {'auction_closing_time': 1774884997.0, 'created_time': 1774524949.236712, 'last_price_update_time': 1774816588.686062}
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK81119') HTTP/1.1" 204 0
2026-03-29 20:36:28 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-29 20:36:28 [auto1.be] INFO: Scrape type for ZJ33794: 2
2026-03-29 20:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-29 20:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with scrape type 2
2026-03-29 20:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with scrape type 2
2026-03-29 20:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b774dfc-948d-53b0-a1a1-a400d054a6c0, identifier: ZJ33794
2026-03-29 20:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-29 20:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-29 20:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794 to the API
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:48:54Z',
 'fuel_type': 'diesel',
 'id': '6b774dfc-948d-53b0-a1a1-a400d054a6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ33794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Saving data for ZJ33794: {'auction_closing_time': 1774885734.0, 'created_time': 1773238108.059606, 'last_price_update_time': 1774816589.209816}
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ33794') HTTP/1.1" 204 0
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Scrape type for VK66376: 2
2026-03-29 20:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-29 20:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059b1df0-5814-574a-965a-c5fe9f46e39a with scrape type 2
2026-03-29 20:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059b1df0-5814-574a-965a-c5fe9f46e39a with scrape type 2
2026-03-29 20:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 059b1df0-5814-574a-965a-c5fe9f46e39a, identifier: VK66376
2026-03-29 20:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-29 20:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-29 20:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376 to the API
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:32:08Z',
 'fuel_type': 'diesel',
 'id': '059b1df0-5814-574a-965a-c5fe9f46e39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK66376',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 303310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Saving data for VK66376: {'auction_closing_time': 1774884728.0, 'created_time': 1774524922.993098, 'last_price_update_time': 1774816589.583984}
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK66376') HTTP/1.1" 204 0
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 20:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:29 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-29 20:36:29 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-29 20:36:29 [auto1.be] INFO: Scrape type for MB15455: 2
2026-03-29 20:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455
2026-03-29 20:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with scrape type 2
2026-03-29 20:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with scrape type 2
2026-03-29 20:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a6ef1ee9-4ded-577e-a398-c311dca1e5b9, identifier: MB15455
2026-03-29 20:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455
2026-03-29 20:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455
2026-03-29 20:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455 to the API
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:01:03Z',
 'fuel_type': 'petrol',
 'id': 'a6ef1ee9-4ded-577e-a398-c311dca1e5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB15455',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 53885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Citroen C5 1.6 THP Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-29 20:36:30 [auto1.be] INFO: Saving data for MB15455: {'auction_closing_time': 1774882863.0, 'created_time': 1774125447.064316, 'last_price_update_time': 1774816590.213661}
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB15455') HTTP/1.1" 204 0
2026-03-29 20:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:30 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-29 20:36:30 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-29 20:36:30 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-29 20:36:30 [auto1.be] INFO: Scrape type for PB96026: 2
2026-03-29 20:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-29 20:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b91f928b-f874-5089-9023-8a78fc38d4f1 with scrape type 2
2026-03-29 20:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b91f928b-f874-5089-9023-8a78fc38d4f1 with scrape type 2
2026-03-29 20:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b91f928b-f874-5089-9023-8a78fc38d4f1, identifier: PB96026
2026-03-29 20:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-29 20:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-29 20:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026 to the API
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:42Z',
 'fuel_type': 'diesel',
 'id': 'b91f928b-f874-5089-9023-8a78fc38d4f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB96026',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 149525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-12',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-29 20:36:30 [auto1.be] INFO: Saving data for PB96026: {'auction_closing_time': 1774882902.0, 'created_time': 1773693513.849546, 'last_price_update_time': 1774816590.740392}
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB96026') HTTP/1.1" 204 0
2026-03-29 20:36:30 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-29 20:36:30 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-29 20:36:30 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-29 20:36:30 [auto1.be] INFO: Scrape type for UH14890: 2
2026-03-29 20:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-29 20:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 216895f9-3ae9-598d-b3cd-35726bb9190c with scrape type 2
2026-03-29 20:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 216895f9-3ae9-598d-b3cd-35726bb9190c with scrape type 2
2026-03-29 20:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 216895f9-3ae9-598d-b3cd-35726bb9190c, identifier: UH14890
2026-03-29 20:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-29 20:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-29 20:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890 to the API
2026-03-29 20:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:20:00Z',
 'fuel_type': 'petrol',
 'id': '216895f9-3ae9-598d-b3cd-35726bb9190c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14890',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 78304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-21',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-29 20:36:31 [auto1.be] INFO: Saving data for UH14890: {'auction_closing_time': 1774884000.0, 'created_time': 1773693525.425046, 'last_price_update_time': 1774816591.391185}
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UH14890') HTTP/1.1" 204 0
2026-03-29 20:36:31 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-29 20:36:31 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-29 20:36:31 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-29 20:36:31 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-29 20:36:31 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-29 20:36:31 [auto1.be] INFO: Scrape type for DP88518: 2
2026-03-29 20:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-29 20:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with scrape type 2
2026-03-29 20:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with scrape type 2
2026-03-29 20:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a4727c9-74d7-5a9c-bbd6-b359597c1961, identifier: DP88518
2026-03-29 20:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-29 20:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-29 20:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518 to the API
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:58Z',
 'fuel_type': 'diesel',
 'id': '4a4727c9-74d7-5a9c-bbd6-b359597c1961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP88518',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 78421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2022}
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-29 20:36:31 [auto1.be] INFO: Saving data for DP88518: {'auction_closing_time': 1774885738.0, 'created_time': 1774524971.043457, 'last_price_update_time': 1774816591.942171}
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP88518') HTTP/1.1" 204 0
2026-03-29 20:36:31 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 20:36:31 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 20:36:31 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-29 20:36:31 [auto1.be] INFO: Scrape type for NB09051: 2
2026-03-29 20:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-29 20:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b2c403-f651-58aa-ae25-5fef150b7bd4 with scrape type 2
2026-03-29 20:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b2c403-f651-58aa-ae25-5fef150b7bd4 with scrape type 2
2026-03-29 20:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58b2c403-f651-58aa-ae25-5fef150b7bd4, identifier: NB09051
2026-03-29 20:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-29 20:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-29 20:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051 to the API
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:03:16Z',
 'fuel_type': 'diesel',
 'id': '58b2c403-f651-58aa-ae25-5fef150b7bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB09051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 41307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Saving data for NB09051: {'auction_closing_time': 1774882996.0, 'created_time': 1773909348.125255, 'last_price_update_time': 1774816592.374196}
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB09051') HTTP/1.1" 204 0
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Scrape type for ZS27075: 2
2026-03-29 20:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-29 20:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678b62c0-d967-5808-b137-82e400e254d3 with scrape type 2
2026-03-29 20:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678b62c0-d967-5808-b137-82e400e254d3 with scrape type 2
2026-03-29 20:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 678b62c0-d967-5808-b137-82e400e254d3, identifier: ZS27075
2026-03-29 20:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-29 20:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-29 20:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075 to the API
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'petrol',
 'id': '678b62c0-d967-5808-b137-82e400e254d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS27075',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 212246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2012}
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Saving data for ZS27075: {'auction_closing_time': 1774886312.0, 'created_time': 1773132399.338948, 'last_price_update_time': 1774816592.845124}
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS27075') HTTP/1.1" 204 0
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 20:36:32 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-29 20:36:32 [auto1.be] INFO: Scrape type for YA85838: 2
2026-03-29 20:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-29 20:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d36432f7-496c-5fc3-813c-05aae0902e94 with scrape type 2
2026-03-29 20:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d36432f7-496c-5fc3-813c-05aae0902e94 with scrape type 2
2026-03-29 20:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d36432f7-496c-5fc3-813c-05aae0902e94, identifier: YA85838
2026-03-29 20:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-29 20:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-29 20:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838 to the API
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:36:03Z',
 'fuel_type': 'diesel',
 'id': 'd36432f7-496c-5fc3-813c-05aae0902e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA85838',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 288011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-06',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2014}
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-29 20:36:33 [auto1.be] INFO: Saving data for YA85838: {'auction_closing_time': 1774884963.0, 'created_time': 1774298173.703762, 'last_price_update_time': 1774816593.387633}
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA85838') HTTP/1.1" 204 0
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-29 20:36:33 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-29 20:36:33 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-29 20:36:33 [auto1.be] INFO: Scrape type for HM69306: 2
2026-03-29 20:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-29 20:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11edb87a-b955-50bc-9cae-bc9047662547 with scrape type 2
2026-03-29 20:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11edb87a-b955-50bc-9cae-bc9047662547 with scrape type 2
2026-03-29 20:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11edb87a-b955-50bc-9cae-bc9047662547, identifier: HM69306
2026-03-29 20:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-29 20:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-29 20:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306 to the API
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:31:53Z',
 'fuel_type': 'petrol',
 'id': '11edb87a-b955-50bc-9cae-bc9047662547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM69306',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 63711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2016}
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-29 20:36:33 [auto1.be] INFO: Saving data for HM69306: {'auction_closing_time': 1774884713.0, 'created_time': 1773780008.269331, 'last_price_update_time': 1774816593.845798}
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM69306') HTTP/1.1" 204 0
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 20:36:33 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-29 20:36:33 [auto1.be] INFO: Scrape type for LE04651: 2
2026-03-29 20:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-29 20:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with scrape type 2
2026-03-29 20:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with scrape type 2
2026-03-29 20:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69, identifier: LE04651
2026-03-29 20:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-29 20:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-29 20:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651 to the API
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:19:19Z',
 'fuel_type': 'diesel',
 'id': 'b9fc4628-ca6c-5c67-ae80-c006e9f1dc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE04651',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 47608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-25',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 JTD SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2016}
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-29 20:36:34 [auto1.be] INFO: Saving data for LE04651: {'auction_closing_time': 1774883959.0, 'created_time': 1774611327.2566, 'last_price_update_time': 1774816594.352423}
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE04651') HTTP/1.1" 204 0
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-29 20:36:34 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-29 20:36:34 [auto1.be] INFO: Scrape type for HW65369: 2
2026-03-29 20:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-29 20:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item babea493-d702-55d5-914b-4e328915b3d6 with scrape type 2
2026-03-29 20:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item babea493-d702-55d5-914b-4e328915b3d6 with scrape type 2
2026-03-29 20:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: babea493-d702-55d5-914b-4e328915b3d6, identifier: HW65369
2026-03-29 20:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-29 20:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-29 20:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369 to the API
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:31:36Z',
 'fuel_type': 'hybrid',
 'id': 'babea493-d702-55d5-914b-4e328915b3d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW65369',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 77633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-29 20:36:34 [auto1.be] INFO: Saving data for HW65369: {'auction_closing_time': 1774884696.0, 'created_time': 1773136838.383482, 'last_price_update_time': 1774816594.788469}
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW65369') HTTP/1.1" 204 0
2026-03-29 20:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:34 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-29 20:36:34 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-29 20:36:34 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-29 20:36:34 [auto1.be] INFO: Scrape type for TS47815: 2
2026-03-29 20:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-29 20:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e7e6f1-e9bb-51de-89e5-d708d248f363 with scrape type 2
2026-03-29 20:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e7e6f1-e9bb-51de-89e5-d708d248f363 with scrape type 2
2026-03-29 20:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9e7e6f1-e9bb-51de-89e5-d708d248f363, identifier: TS47815
2026-03-29 20:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-29 20:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-29 20:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815 to the API
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:25:43Z',
 'fuel_type': 'diesel',
 'id': 'e9e7e6f1-e9bb-51de-89e5-d708d248f363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS47815',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 167217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-16',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD 70 Multijet Active',
 'transmission': 'manual',
 'trim': '70 Multijet Active',
 'year': 2004}
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Saving data for TS47815: {'auction_closing_time': 1774884343.0, 'created_time': 1774611325.841954, 'last_price_update_time': 1774816595.312829}
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS47815') HTTP/1.1" 204 0
2026-03-29 20:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for EK41744: 2
2026-03-29 20:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744
2026-03-29 20:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e838b482-319b-5424-b12a-fef0fae33720 with scrape type 2
2026-03-29 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e838b482-319b-5424-b12a-fef0fae33720 with scrape type 2
2026-03-29 20:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e838b482-319b-5424-b12a-fef0fae33720, identifier: EK41744
2026-03-29 20:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744
2026-03-29 20:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744
2026-03-29 20:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744 to the API
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:56:36Z',
 'fuel_type': 'diesel',
 'id': 'e838b482-319b-5424-b12a-fef0fae33720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK41744',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 68250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-12',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Saving data for EK41744: {'auction_closing_time': 1774886196.0, 'created_time': 1773240292.775042, 'last_price_update_time': 1774816595.915496}
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK41744') HTTP/1.1" 204 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-29 20:36:35 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-29 20:36:35 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Scrape type for RA81540: 2
2026-03-29 20:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-29 20:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b72f69-60b5-5888-aa23-9f9a474ddc4d with scrape type 2
2026-03-29 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b72f69-60b5-5888-aa23-9f9a474ddc4d with scrape type 2
2026-03-29 20:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15b72f69-60b5-5888-aa23-9f9a474ddc4d, identifier: RA81540
2026-03-29 20:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-29 20:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-29 20:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540 to the API
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:36:43Z',
 'fuel_type': 'petrol',
 'id': '15b72f69-60b5-5888-aa23-9f9a474ddc4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA81540',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 113473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line R&B',
 'transmission': 'manual',
 'trim': 'ST-Line R&B',
 'year': 2018}
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Saving data for RA81540: {'auction_closing_time': 1774885003.0, 'created_time': 1773240354.480115, 'last_price_update_time': 1774816596.488525}
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA81540') HTTP/1.1" 204 0
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Scrape type for AG87445: 2
2026-03-29 20:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-29 20:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b75cb-574d-5037-83d7-0dd641cabc89 with scrape type 2
2026-03-29 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d5b75cb-574d-5037-83d7-0dd641cabc89 with scrape type 2
2026-03-29 20:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d5b75cb-574d-5037-83d7-0dd641cabc89, identifier: AG87445
2026-03-29 20:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-29 20:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-29 20:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445 to the API
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:03Z',
 'fuel_type': 'diesel',
 'id': '9d5b75cb-574d-5037-83d7-0dd641cabc89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG87445',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 296960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2021}
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-29 20:36:36 [auto1.be] INFO: Saving data for AG87445: {'auction_closing_time': 1774885203.0, 'created_time': 1774643744.61289, 'last_price_update_time': 1774816596.963483}
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG87445') HTTP/1.1" 204 0
2026-03-29 20:36:36 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-29 20:36:37 [auto1.be] INFO: Scrape type for LX45606: 2
2026-03-29 20:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-29 20:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb4a1a1-2934-5c80-a519-2323b635ccf3 with scrape type 2
2026-03-29 20:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfb4a1a1-2934-5c80-a519-2323b635ccf3 with scrape type 2
2026-03-29 20:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bfb4a1a1-2934-5c80-a519-2323b635ccf3, identifier: LX45606
2026-03-29 20:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-29 20:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-29 20:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606 to the API
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:01:08Z',
 'fuel_type': 'diesel',
 'id': 'bfb4a1a1-2934-5c80-a519-2323b635ccf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX45606',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Rodius',
 'odometer': 276844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Ssangyong Rodius 2.2 TD Sapphire 4WD',
 'transmission': 'automatic',
 'trim': 'Sapphire 4WD',
 'year': 2018}
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-29 20:36:37 [auto1.be] INFO: Saving data for LX45606: {'auction_closing_time': 1774882868.0, 'created_time': 1774611354.488798, 'last_price_update_time': 1774816597.385864}
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LX45606') HTTP/1.1" 204 0
2026-03-29 20:36:37 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-29 20:36:37 [auto1.be] INFO: Scrape type for DE21401: 2
2026-03-29 20:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-29 20:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e211255-7efb-55df-a7e6-91faa685c42c with scrape type 2
2026-03-29 20:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e211255-7efb-55df-a7e6-91faa685c42c with scrape type 2
2026-03-29 20:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e211255-7efb-55df-a7e6-91faa685c42c, identifier: DE21401
2026-03-29 20:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 20:36:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-29 20:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401 to the API
2026-03-29 20:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:16:37Z',
 'fuel_type': 'petrol',
 'id': '3e211255-7efb-55df-a7e6-91faa685c42c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE21401',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 38598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-29 20:36:38 [auto1.be] INFO: Saving data for DE21401: {'auction_closing_time': 1774883797.0, 'created_time': 1774611338.263394, 'last_price_update_time': 1774816598.840185}
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE21401') HTTP/1.1" 204 0
2026-03-29 20:36:38 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 20:36:38 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 20:36:38 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-29 20:36:38 [auto1.be] INFO: Scrape type for VE52917: 2
2026-03-29 20:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-29 20:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with scrape type 2
2026-03-29 20:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with scrape type 2
2026-03-29 20:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15ea9686-0119-52b0-8be3-4e94efd1c0e1, identifier: VE52917
2026-03-29 20:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-29 20:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-29 20:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917 to the API
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:11:02Z',
 'fuel_type': 'diesel',
 'id': '15ea9686-0119-52b0-8be3-4e94efd1c0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE52917',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 206189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-29 20:36:39 [auto1.be] INFO: Saving data for VE52917: {'auction_closing_time': 1774883462.0, 'created_time': 1773693578.098352, 'last_price_update_time': 1774816599.243573}
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE52917') HTTP/1.1" 204 0
2026-03-29 20:36:39 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-29 20:36:39 [auto1.be] INFO: Scrape type for GC03502: 2
2026-03-29 20:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-29 20:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with scrape type 2
2026-03-29 20:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with scrape type 2
2026-03-29 20:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3, identifier: GC03502
2026-03-29 20:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-29 20:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-29 20:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502 to the API
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:07Z',
 'fuel_type': 'petrol',
 'id': '123cbe69-4dfe-5185-bfd3-9ada7de4c9b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC03502',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 154692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-29 20:36:39 [auto1.be] INFO: Saving data for GC03502: {'auction_closing_time': 1774884427.0, 'created_time': 1773131891.522737, 'last_price_update_time': 1774816599.673239}
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC03502') HTTP/1.1" 204 0
2026-03-29 20:36:39 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 20:36:39 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-29 20:36:39 [auto1.be] INFO: Scrape type for YA14339: 2
2026-03-29 20:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-29 20:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eff9184-820c-50ba-a803-b4fc692dfb52 with scrape type 2
2026-03-29 20:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eff9184-820c-50ba-a803-b4fc692dfb52 with scrape type 2
2026-03-29 20:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4eff9184-820c-50ba-a803-b4fc692dfb52, identifier: YA14339
2026-03-29 20:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-29 20:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-29 20:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339 to the API
2026-03-29 20:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:34Z',
 'fuel_type': 'diesel',
 'id': '4eff9184-820c-50ba-a803-b4fc692dfb52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA14339',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 225421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2015}
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-29 20:36:40 [auto1.be] INFO: Saving data for YA14339: {'auction_closing_time': 1774883434.0, 'created_time': 1774524953.133571, 'last_price_update_time': 1774816600.774255}
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA14339') HTTP/1.1" 204 0
2026-03-29 20:36:40 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 20:36:40 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 20:36:40 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:40 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-29 20:36:40 [auto1.be] INFO: Scrape type for JZ92177: 2
2026-03-29 20:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-29 20:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with scrape type 2
2026-03-29 20:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with scrape type 2
2026-03-29 20:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 979ebab0-c3db-57cc-9de9-b9e30813e9d1, identifier: JZ92177
2026-03-29 20:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-29 20:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-29 20:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177 to the API
2026-03-29 20:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:20:50Z',
 'fuel_type': 'petrol',
 'id': '979ebab0-c3db-57cc-9de9-b9e30813e9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ92177',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 19719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-07',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2024}
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Saving data for JZ92177: {'auction_closing_time': 1774884050.0, 'created_time': 1773238513.89548, 'last_price_update_time': 1774816601.166532}
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ92177') HTTP/1.1" 204 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for VL69873: 2
2026-03-29 20:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-29 20:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with scrape type 2
2026-03-29 20:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with scrape type 2
2026-03-29 20:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5, identifier: VL69873
2026-03-29 20:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-29 20:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-29 20:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873 to the API
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:28:03Z',
 'fuel_type': 'diesel',
 'id': '5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL69873',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 196575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Saving data for VL69873: {'auction_closing_time': 1774884483.0, 'created_time': 1773866411.866313, 'last_price_update_time': 1774816601.670406}
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL69873') HTTP/1.1" 204 0
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 20:36:41 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-29 20:36:41 [auto1.be] INFO: Scrape type for FR21473: 2
2026-03-29 20:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-29 20:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with scrape type 2
2026-03-29 20:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with scrape type 2
2026-03-29 20:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1, identifier: FR21473
2026-03-29 20:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-29 20:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-29 20:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473 to the API
2026-03-29 20:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:54:02Z',
 'fuel_type': 'diesel',
 'id': 'd8c3eb4d-4d2b-59c5-aa67-3665c4f93af1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR21473',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 146761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-29 20:36:42 [auto1.be] INFO: Saving data for FR21473: {'auction_closing_time': 1774886042.0, 'created_time': 1773909349.938396, 'last_price_update_time': 1774816602.196633}
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR21473') HTTP/1.1" 204 0
2026-03-29 20:36:42 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-29 20:36:42 [auto1.be] INFO: Scrape type for FK29667: 2
2026-03-29 20:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-29 20:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6fa5728-227f-5472-97d4-e131b884a993 with scrape type 2
2026-03-29 20:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6fa5728-227f-5472-97d4-e131b884a993 with scrape type 2
2026-03-29 20:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6fa5728-227f-5472-97d4-e131b884a993, identifier: FK29667
2026-03-29 20:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-29 20:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-29 20:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667 to the API
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:11:50Z',
 'fuel_type': 'diesel',
 'id': 'b6fa5728-227f-5472-97d4-e131b884a993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29667',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 164568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Pritsche 50 lang RWD',
 'transmission': 'manual',
 'trim': 'Pritsche 50 lang RWD',
 'year': 2020}
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-29 20:36:42 [auto1.be] INFO: Saving data for FK29667: {'auction_closing_time': 1774883510.0, 'created_time': 1774524980.883255, 'last_price_update_time': 1774816602.56655}
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK29667') HTTP/1.1" 204 0
2026-03-29 20:36:42 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 20:36:42 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-29 20:36:42 [auto1.be] INFO: Scrape type for AV34296: 2
2026-03-29 20:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-29 20:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with scrape type 2
2026-03-29 20:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with scrape type 2
2026-03-29 20:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb, identifier: AV34296
2026-03-29 20:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-29 20:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-29 20:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296 to the API
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:18Z',
 'fuel_type': 'diesel',
 'id': '34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV34296',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 209412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2017}
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Saving data for AV34296: {'auction_closing_time': 1774885218.0, 'created_time': 1773134257.558797, 'last_price_update_time': 1774816603.012237}
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV34296') HTTP/1.1" 204 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for SB45161: 2
2026-03-29 20:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-29 20:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with scrape type 2
2026-03-29 20:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with scrape type 2
2026-03-29 20:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6b4a665-3a4c-5f0f-aa51-c983852f4d46, identifier: SB45161
2026-03-29 20:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-29 20:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-29 20:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161 to the API
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:11:59Z',
 'fuel_type': 'diesel',
 'id': 'c6b4a665-3a4c-5f0f-aa51-c983852f4d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB45161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 114238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d T 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': 'T 4Matic Exclusive',
 'year': 2018}
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Saving data for SB45161: {'auction_closing_time': 1774883519.0, 'created_time': 1773780008.614746, 'last_price_update_time': 1774816603.422057}
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB45161') HTTP/1.1" 204 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for YF28674: 2
2026-03-29 20:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-29 20:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dbd15a-1c73-5853-ab10-b6e315cb2479 with scrape type 2
2026-03-29 20:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45dbd15a-1c73-5853-ab10-b6e315cb2479 with scrape type 2
2026-03-29 20:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45dbd15a-1c73-5853-ab10-b6e315cb2479, identifier: YF28674
2026-03-29 20:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-29 20:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-29 20:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674 to the API
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:32:07Z',
 'fuel_type': 'petrol',
 'id': '45dbd15a-1c73-5853-ab10-b6e315cb2479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF28674',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 19883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Saving data for YF28674: {'auction_closing_time': 1774884727.0, 'created_time': 1774298191.047787, 'last_price_update_time': 1774816603.827645}
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF28674') HTTP/1.1" 204 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 20:36:43 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-29 20:36:43 [auto1.be] INFO: Scrape type for BS55977: 2
2026-03-29 20:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-29 20:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with scrape type 2
2026-03-29 20:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with scrape type 2
2026-03-29 20:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d, identifier: BS55977
2026-03-29 20:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-29 20:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-29 20:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977 to the API
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:23:49Z',
 'fuel_type': 'petrol',
 'id': 'f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS55977',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 21978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-13',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2022}
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Saving data for BS55977: {'auction_closing_time': 1774884229.0, 'created_time': 1773693669.341309, 'last_price_update_time': 1774816604.330598}
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS55977') HTTP/1.1" 204 0
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Scrape type for ZR45530: 2
2026-03-29 20:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-29 20:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with scrape type 2
2026-03-29 20:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with scrape type 2
2026-03-29 20:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58be042d-1b7e-5467-b6e9-ade87f6ccce1, identifier: ZR45530
2026-03-29 20:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-29 20:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-29 20:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530 to the API
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:14Z',
 'fuel_type': 'diesel',
 'id': '58be042d-1b7e-5467-b6e9-ade87f6ccce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR45530',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 223109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueTDI',
 'transmission': 'manual',
 'trim': 'Comfortline BlueTDI',
 'year': 2013}
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Saving data for ZR45530: {'auction_closing_time': 1774883594.0, 'created_time': 1774611360.700796, 'last_price_update_time': 1774816604.891045}
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR45530') HTTP/1.1" 204 0
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 20:36:44 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-29 20:36:44 [auto1.be] INFO: Scrape type for KP16038: 2
2026-03-29 20:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-29 20:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad01e60-ac17-529b-ab84-522576749a70 with scrape type 2
2026-03-29 20:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad01e60-ac17-529b-ab84-522576749a70 with scrape type 2
2026-03-29 20:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ad01e60-ac17-529b-ab84-522576749a70, identifier: KP16038
2026-03-29 20:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-29 20:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-29 20:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038 to the API
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:10Z',
 'fuel_type': 'diesel',
 'id': '6ad01e60-ac17-529b-ab84-522576749a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 157350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-29 20:36:45 [auto1.be] INFO: Saving data for KP16038: {'auction_closing_time': 1774885090.0, 'created_time': 1773693559.723935, 'last_price_update_time': 1774816605.357854}
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP16038') HTTP/1.1" 204 0
2026-03-29 20:36:45 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 20:36:45 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-29 20:36:45 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-29 20:36:45 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-29 20:36:45 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-29 20:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:45 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:45 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-29 20:36:45 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-29 20:36:45 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-29 20:36:45 [auto1.be] INFO: Scrape type for UC56570: 2
2026-03-29 20:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570
2026-03-29 20:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with scrape type 2
2026-03-29 20:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with scrape type 2
2026-03-29 20:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0f07f45-e8a7-54b0-aff5-40a2a981abb5, identifier: UC56570
2026-03-29 20:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570
2026-03-29 20:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570
2026-03-29 20:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570 to the API
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'diesel',
 'id': 'b0f07f45-e8a7-54b0-aff5-40a2a981abb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC56570',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 336828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.9 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-29 20:36:45 [auto1.be] INFO: Saving data for UC56570: {'auction_closing_time': 1774885534.0, 'created_time': 1774730161.083736, 'last_price_update_time': 1774816605.920387}
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC56570') HTTP/1.1" 204 0
2026-03-29 20:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for CP42003: 2
2026-03-29 20:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-29 20:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b225942-8429-5d44-a314-122de3d7692b with scrape type 2
2026-03-29 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b225942-8429-5d44-a314-122de3d7692b with scrape type 2
2026-03-29 20:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b225942-8429-5d44-a314-122de3d7692b, identifier: CP42003
2026-03-29 20:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-29 20:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-29 20:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003 to the API
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:14:17Z',
 'fuel_type': 'petrol',
 'id': '6b225942-8429-5d44-a314-122de3d7692b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP42003',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 208306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2018}
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Saving data for CP42003: {'auction_closing_time': 1774883657.0, 'created_time': 1773224388.316616, 'last_price_update_time': 1774816606.499864}
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP42003') HTTP/1.1" 204 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 20:36:46 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Scrape type for BU90061: 2
2026-03-29 20:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-29 20:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c147655d-5598-5a29-851e-ac380e05905d with scrape type 2
2026-03-29 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c147655d-5598-5a29-851e-ac380e05905d with scrape type 2
2026-03-29 20:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c147655d-5598-5a29-851e-ac380e05905d, identifier: BU90061
2026-03-29 20:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-29 20:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-29 20:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061 to the API
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:37:25Z',
 'fuel_type': 'diesel',
 'id': 'c147655d-5598-5a29-851e-ac380e05905d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU90061',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 254780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-29 20:36:46 [auto1.be] INFO: Saving data for BU90061: {'auction_closing_time': 1774885045.0, 'created_time': 1773238342.478019, 'last_price_update_time': 1774816606.975965}
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU90061') HTTP/1.1" 204 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for HF54985: 2
2026-03-29 20:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985
2026-03-29 20:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c636eb8-c38e-5634-ac96-cec88a7229f6 with scrape type 2
2026-03-29 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c636eb8-c38e-5634-ac96-cec88a7229f6 with scrape type 2
2026-03-29 20:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0c636eb8-c38e-5634-ac96-cec88a7229f6, identifier: HF54985
2026-03-29 20:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985
2026-03-29 20:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985
2026-03-29 20:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985 to the API
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:34Z',
 'fuel_type': 'diesel',
 'id': '0c636eb8-c38e-5634-ac96-cec88a7229f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF54985',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 149553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2020}
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Saving data for HF54985: {'auction_closing_time': 1774884094.0, 'created_time': 1773384242.175189, 'last_price_update_time': 1774816607.473651}
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HF54985') HTTP/1.1" 204 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-29 20:36:47 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Scrape type for YH09444: 2
2026-03-29 20:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-29 20:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4abc93d3-0227-5f90-a27b-4ec27ca62880 with scrape type 2
2026-03-29 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4abc93d3-0227-5f90-a27b-4ec27ca62880 with scrape type 2
2026-03-29 20:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4abc93d3-0227-5f90-a27b-4ec27ca62880, identifier: YH09444
2026-03-29 20:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-29 20:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-29 20:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444 to the API
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'diesel',
 'id': '4abc93d3-0227-5f90-a27b-4ec27ca62880',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH09444',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 97492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-24',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-29 20:36:47 [auto1.be] INFO: Saving data for YH09444: {'auction_closing_time': 1774885296.0, 'created_time': 1774611328.574673, 'last_price_update_time': 1774816607.992312}
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH09444') HTTP/1.1" 204 0
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-29 20:36:48 [auto1.be] INFO: Scrape type for JP67733: 2
2026-03-29 20:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-29 20:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba092004-345f-5dc4-93eb-fb7dd27a70dd with scrape type 2
2026-03-29 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba092004-345f-5dc4-93eb-fb7dd27a70dd with scrape type 2
2026-03-29 20:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba092004-345f-5dc4-93eb-fb7dd27a70dd, identifier: JP67733
2026-03-29 20:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-29 20:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-29 20:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733 to the API
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:09:58Z',
 'fuel_type': 'hybrid',
 'id': 'ba092004-345f-5dc4-93eb-fb7dd27a70dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP67733',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 185798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 Hybrid BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'BlueTEC Elegance',
 'year': 2015}
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-29 20:36:48 [auto1.be] INFO: Saving data for JP67733: {'auction_closing_time': 1774883398.0, 'created_time': 1774643744.04436, 'last_price_update_time': 1774816608.460138}
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JP67733') HTTP/1.1" 204 0
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-29 20:36:48 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-29 20:36:48 [auto1.be] INFO: Scrape type for ES19550: 2
2026-03-29 20:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-29 20:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd055418-f39a-5fdf-870a-43303d4beb5b with scrape type 2
2026-03-29 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd055418-f39a-5fdf-870a-43303d4beb5b with scrape type 2
2026-03-29 20:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd055418-f39a-5fdf-870a-43303d4beb5b, identifier: ES19550
2026-03-29 20:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-29 20:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-29 20:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550 to the API
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:25:42Z',
 'fuel_type': 'hybrid',
 'id': 'fd055418-f39a-5fdf-870a-43303d4beb5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES19550',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 157904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-29 20:36:48 [auto1.be] INFO: Saving data for ES19550: {'auction_closing_time': 1774884342.0, 'created_time': 1773301743.386105, 'last_price_update_time': 1774816608.884773}
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES19550') HTTP/1.1" 204 0
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-29 20:36:48 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-29 20:36:48 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-29 20:36:49 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-29 20:36:49 [auto1.be] INFO: Scrape type for YJ44532: 2
2026-03-29 20:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-29 20:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a7a112-8ff5-5456-9337-a4b1c69f3112 with scrape type 2
2026-03-29 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50a7a112-8ff5-5456-9337-a4b1c69f3112 with scrape type 2
2026-03-29 20:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 50a7a112-8ff5-5456-9337-a4b1c69f3112, identifier: YJ44532
2026-03-29 20:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-29 20:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-29 20:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532 to the API
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:07Z',
 'fuel_type': 'diesel',
 'id': '50a7a112-8ff5-5456-9337-a4b1c69f3112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ44532',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 151596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-29',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2012}
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-29 20:36:49 [auto1.be] INFO: Saving data for YJ44532: {'auction_closing_time': 1774883347.0, 'created_time': 1773239951.955512, 'last_price_update_time': 1774816609.394409}
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ44532') HTTP/1.1" 204 0
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 20:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:49 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-29 20:36:49 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 20:36:49 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-29 20:36:49 [auto1.be] INFO: Scrape type for KF81819: 2
2026-03-29 20:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-29 20:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62194af-a766-5e06-b7d1-4d103857dd73 with scrape type 2
2026-03-29 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62194af-a766-5e06-b7d1-4d103857dd73 with scrape type 2
2026-03-29 20:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c62194af-a766-5e06-b7d1-4d103857dd73, identifier: KF81819
2026-03-29 20:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-29 20:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-29 20:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819 to the API
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:38:58Z',
 'fuel_type': 'petrol',
 'id': 'c62194af-a766-5e06-b7d1-4d103857dd73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF81819',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 125165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-02',
 'seller_name': None,
 'title': 'Chrysler 300 C 2.7',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Saving data for KF81819: {'auction_closing_time': 1774885138.0, 'created_time': 1773301686.459703, 'last_price_update_time': 1774816610.196147}
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF81819') HTTP/1.1" 204 0
2026-03-29 20:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Scrape type for GP50240: 2
2026-03-29 20:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240
2026-03-29 20:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0087310-ce2f-5372-bd82-e93383830886 with scrape type 2
2026-03-29 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0087310-ce2f-5372-bd82-e93383830886 with scrape type 2
2026-03-29 20:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0087310-ce2f-5372-bd82-e93383830886, identifier: GP50240
2026-03-29 20:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240
2026-03-29 20:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240
2026-03-29 20:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240 to the API
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:36:22Z',
 'fuel_type': 'petrol',
 'id': 'e0087310-ce2f-5372-bd82-e93383830886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP50240',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 109178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2016}
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Saving data for GP50240: {'auction_closing_time': 1774884982.0, 'created_time': 1773135498.259113, 'last_price_update_time': 1774816610.634513}
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GP50240') HTTP/1.1" 204 0
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 20:36:50 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-29 20:36:50 [auto1.be] INFO: Scrape type for DF09339: 2
2026-03-29 20:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-29 20:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca9d3055-ca4d-5125-827c-f168fc7891c6 with scrape type 2
2026-03-29 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca9d3055-ca4d-5125-827c-f168fc7891c6 with scrape type 2
2026-03-29 20:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca9d3055-ca4d-5125-827c-f168fc7891c6, identifier: DF09339
2026-03-29 20:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-29 20:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-29 20:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339 to the API
2026-03-29 20:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:25:43Z',
 'fuel_type': 'diesel',
 'id': 'ca9d3055-ca4d-5125-827c-f168fc7891c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF09339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 92653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-18',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2019}
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-29 20:36:51 [auto1.be] INFO: Saving data for DF09339: {'auction_closing_time': 1774884343.0, 'created_time': 1774341336.667129, 'last_price_update_time': 1774816611.242803}
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF09339') HTTP/1.1" 204 0
2026-03-29 20:36:51 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-29 20:36:51 [auto1.be] INFO: Scrape type for LY80968: 2
2026-03-29 20:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-29 20:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with scrape type 2
2026-03-29 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with scrape type 2
2026-03-29 20:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea6776dc-8dfa-5974-bfab-c120f1cc51b9, identifier: LY80968
2026-03-29 20:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-29 20:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-29 20:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968 to the API
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:30Z',
 'fuel_type': 'petrol',
 'id': 'ea6776dc-8dfa-5974-bfab-c120f1cc51b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY80968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 57491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-29 20:36:51 [auto1.be] INFO: Saving data for LY80968: {'auction_closing_time': 1774883730.0, 'created_time': 1773477347.71579, 'last_price_update_time': 1774816611.747422}
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY80968') HTTP/1.1" 204 0
2026-03-29 20:36:51 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 20:36:51 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-29 20:36:51 [auto1.be] INFO: Scrape type for BX96549: 2
2026-03-29 20:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-29 20:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9932f2-b2a2-5d1b-9377-395ab8386859 with scrape type 2
2026-03-29 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9932f2-b2a2-5d1b-9377-395ab8386859 with scrape type 2
2026-03-29 20:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec9932f2-b2a2-5d1b-9377-395ab8386859, identifier: BX96549
2026-03-29 20:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-29 20:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-29 20:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549 to the API
2026-03-29 20:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:20:57Z',
 'fuel_type': 'diesel',
 'id': 'ec9932f2-b2a2-5d1b-9377-395ab8386859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX96549',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 224163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Advantage',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Advantage',
 'year': 2016}
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Saving data for BX96549: {'auction_closing_time': 1774884057.0, 'created_time': 1773693532.930734, 'last_price_update_time': 1774816612.181756}
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX96549') HTTP/1.1" 204 0
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Scrape type for KF50538: 2
2026-03-29 20:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-29 20:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with scrape type 2
2026-03-29 20:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with scrape type 2
2026-03-29 20:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6733d0f4-f06a-58a8-8654-5ebeee483ee0, identifier: KF50538
2026-03-29 20:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-29 20:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-29 20:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538 to the API
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:18Z',
 'fuel_type': 'diesel',
 'id': '6733d0f4-f06a-58a8-8654-5ebeee483ee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF50538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 145675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Saving data for KF50538: {'auction_closing_time': 1774883958.0, 'created_time': 1773240138.017526, 'last_price_update_time': 1774816612.697441}
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF50538') HTTP/1.1" 204 0
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 20:36:52 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-29 20:36:52 [auto1.be] INFO: Scrape type for CB53563: 2
2026-03-29 20:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-29 20:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ebb0529-d9de-5be2-821d-77f9a0813017 with scrape type 2
2026-03-29 20:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ebb0529-d9de-5be2-821d-77f9a0813017 with scrape type 2
2026-03-29 20:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ebb0529-d9de-5be2-821d-77f9a0813017, identifier: CB53563
2026-03-29 20:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-29 20:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-29 20:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563 to the API
2026-03-29 20:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:12Z',
 'fuel_type': 'diesel',
 'id': '8ebb0529-d9de-5be2-821d-77f9a0813017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB53563',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 179557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang FWD',
 'transmission': 'automatic',
 'trim': 'Kasten 35 mittellang FWD',
 'year': 2022}
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Saving data for CB53563: {'auction_closing_time': 1774884072.0, 'created_time': 1773866674.169586, 'last_price_update_time': 1774816613.131629}
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB53563') HTTP/1.1" 204 0
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-29 20:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:53 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Scrape type for AK84541: 2
2026-03-29 20:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-29 20:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with scrape type 2
2026-03-29 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with scrape type 2
2026-03-29 20:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9, identifier: AK84541
2026-03-29 20:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-29 20:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-29 20:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541 to the API
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:53:24Z',
 'fuel_type': 'diesel',
 'id': 'e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK84541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 182639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2014}
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Saving data for AK84541: {'auction_closing_time': 1774886004.0, 'created_time': 1773693866.665572, 'last_price_update_time': 1774816613.858789}
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK84541') HTTP/1.1" 204 0
2026-03-29 20:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:53 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-29 20:36:53 [auto1.be] INFO: Scrape type for PM96543: 2
2026-03-29 20:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-29 20:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3094276f-f50f-5560-840c-9715111c4757 with scrape type 2
2026-03-29 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3094276f-f50f-5560-840c-9715111c4757 with scrape type 2
2026-03-29 20:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3094276f-f50f-5560-840c-9715111c4757, identifier: PM96543
2026-03-29 20:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-29 20:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-29 20:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543 to the API
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:57:18Z',
 'fuel_type': 'petrol',
 'id': '3094276f-f50f-5560-840c-9715111c4757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM96543',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 121557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2021}
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-29 20:36:54 [auto1.be] INFO: Saving data for PM96543: {'auction_closing_time': 1774886238.0, 'created_time': 1773132475.845034, 'last_price_update_time': 1774816614.283456}
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM96543') HTTP/1.1" 204 0
2026-03-29 20:36:54 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 20:36:54 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 20:36:54 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 20:36:54 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-29 20:36:54 [auto1.be] INFO: Scrape type for XE64009: 2
2026-03-29 20:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-29 20:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc4ff40-73f2-529a-842e-244a2a10a84f with scrape type 2
2026-03-29 20:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc4ff40-73f2-529a-842e-244a2a10a84f with scrape type 2
2026-03-29 20:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acc4ff40-73f2-529a-842e-244a2a10a84f, identifier: XE64009
2026-03-29 20:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-29 20:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-29 20:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009 to the API
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'diesel',
 'id': 'acc4ff40-73f2-529a-842e-244a2a10a84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE64009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 230277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-29 20:36:54 [auto1.be] INFO: Saving data for XE64009: {'auction_closing_time': 1774885441.0, 'created_time': 1774524970.16392, 'last_price_update_time': 1774816614.668638}
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE64009') HTTP/1.1" 204 0
2026-03-29 20:36:54 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-29 20:36:54 [auto1.be] INFO: Scrape type for KU26204: 2
2026-03-29 20:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-29 20:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc75f6b6-f632-59f3-b824-437bc69208ee with scrape type 2
2026-03-29 20:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc75f6b6-f632-59f3-b824-437bc69208ee with scrape type 2
2026-03-29 20:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc75f6b6-f632-59f3-b824-437bc69208ee, identifier: KU26204
2026-03-29 20:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-29 20:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-29 20:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204 to the API
2026-03-29 20:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:32Z',
 'fuel_type': 'petrol',
 'id': 'fc75f6b6-f632-59f3-b824-437bc69208ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU26204',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 55645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-11',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Life Pack M',
 'transmission': 'manual',
 'trim': 'Life Pack M',
 'year': 2021}
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-29 20:36:55 [auto1.be] INFO: Saving data for KU26204: {'auction_closing_time': 1774884992.0, 'created_time': 1774524952.752341, 'last_price_update_time': 1774816615.131667}
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU26204') HTTP/1.1" 204 0
2026-03-29 20:36:55 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-29 20:36:55 [auto1.be] INFO: Scrape type for ZN66630: 2
2026-03-29 20:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-29 20:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a29ab3b-b179-569f-a52d-ca54419ea957 with scrape type 2
2026-03-29 20:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a29ab3b-b179-569f-a52d-ca54419ea957 with scrape type 2
2026-03-29 20:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a29ab3b-b179-569f-a52d-ca54419ea957, identifier: ZN66630
2026-03-29 20:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-29 20:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-29 20:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630 to the API
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '7a29ab3b-b179-569f-a52d-ca54419ea957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN66630',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 115965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-29 20:36:55 [auto1.be] INFO: Saving data for ZN66630: {'auction_closing_time': 1774886055.0, 'created_time': 1774611391.457045, 'last_price_update_time': 1774816615.547788}
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN66630') HTTP/1.1" 204 0
2026-03-29 20:36:55 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 20:36:55 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-29 20:36:55 [auto1.be] INFO: Scrape type for ZG50395: 2
2026-03-29 20:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-29 20:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with scrape type 2
2026-03-29 20:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with scrape type 2
2026-03-29 20:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346, identifier: ZG50395
2026-03-29 20:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-29 20:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-29 20:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395 to the API
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:17Z',
 'fuel_type': 'diesel',
 'id': '2771e6e6-d7a8-5505-9977-4d8b3d8a4346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG50395',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 271982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-25',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-29 20:36:55 [auto1.be] INFO: Saving data for ZG50395: {'auction_closing_time': 1774885817.0, 'created_time': 1774524931.874126, 'last_price_update_time': 1774816615.907435}
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG50395') HTTP/1.1" 204 0
2026-03-29 20:36:55 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-29 20:36:55 [auto1.be] INFO: Scrape type for TM97404: 2
2026-03-29 20:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-29 20:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with scrape type 2
2026-03-29 20:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with scrape type 2
2026-03-29 20:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2, identifier: TM97404
2026-03-29 20:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-29 20:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-29 20:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404 to the API
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:27:35Z',
 'fuel_type': 'diesel',
 'id': '0f0e0f58-7dbf-506b-b74a-e2d3445dacf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM97404',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 246819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-29 20:36:56 [auto1.be] INFO: Saving data for TM97404: {'auction_closing_time': 1774884455.0, 'created_time': 1773240294.153355, 'last_price_update_time': 1774816616.829577}
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM97404') HTTP/1.1" 204 0
2026-03-29 20:36:56 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 20:36:56 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-29 20:36:56 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-29 20:36:56 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-29 20:36:56 [auto1.be] INFO: Scrape type for UT04463: 2
2026-03-29 20:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-29 20:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab6c094-4925-54cd-a193-7a20a3b2c51d with scrape type 2
2026-03-29 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab6c094-4925-54cd-a193-7a20a3b2c51d with scrape type 2
2026-03-29 20:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ab6c094-4925-54cd-a193-7a20a3b2c51d, identifier: UT04463
2026-03-29 20:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-29 20:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-29 20:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463 to the API
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:17:23Z',
 'fuel_type': 'diesel',
 'id': '7ab6c094-4925-54cd-a193-7a20a3b2c51d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04463',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 210147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-29 20:36:57 [auto1.be] INFO: Saving data for UT04463: {'auction_closing_time': 1774883843.0, 'created_time': 1773866701.354523, 'last_price_update_time': 1774816617.279378}
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT04463') HTTP/1.1" 204 0
2026-03-29 20:36:57 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 20:36:57 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-29 20:36:57 [auto1.be] INFO: Scrape type for WE53696: 2
2026-03-29 20:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-29 20:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a483acd3-a45f-5997-81bc-8906e425df72 with scrape type 2
2026-03-29 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a483acd3-a45f-5997-81bc-8906e425df72 with scrape type 2
2026-03-29 20:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a483acd3-a45f-5997-81bc-8906e425df72, identifier: WE53696
2026-03-29 20:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-29 20:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-29 20:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696 to the API
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:33:17Z',
 'fuel_type': 'diesel',
 'id': 'a483acd3-a45f-5997-81bc-8906e425df72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE53696',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 251640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-08',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-29 20:36:57 [auto1.be] INFO: Saving data for WE53696: {'auction_closing_time': 1774884797.0, 'created_time': 1773136331.225977, 'last_price_update_time': 1774816617.715307}
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE53696') HTTP/1.1" 204 0
2026-03-29 20:36:57 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 20:36:57 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-29 20:36:57 [auto1.be] INFO: Scrape type for NP69529: 2
2026-03-29 20:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-29 20:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf917ded-7fe1-56cc-af78-e63f7a25bf1a with scrape type 2
2026-03-29 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf917ded-7fe1-56cc-af78-e63f7a25bf1a with scrape type 2
2026-03-29 20:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf917ded-7fe1-56cc-af78-e63f7a25bf1a, identifier: NP69529
2026-03-29 20:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-29 20:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-29 20:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529 to the API
2026-03-29 20:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:03:58Z',
 'fuel_type': 'petrol',
 'id': 'cf917ded-7fe1-56cc-af78-e63f7a25bf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP69529',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 155186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-01',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-29 20:36:58 [auto1.be] INFO: Saving data for NP69529: {'auction_closing_time': 1774883038.0, 'created_time': 1774611354.839513, 'last_price_update_time': 1774816618.147445}
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP69529') HTTP/1.1" 204 0
2026-03-29 20:36:58 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-29 20:36:58 [auto1.be] INFO: Scrape type for WU38196: 2
2026-03-29 20:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-29 20:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with scrape type 2
2026-03-29 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with scrape type 2
2026-03-29 20:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0, identifier: WU38196
2026-03-29 20:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-29 20:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-29 20:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196 to the API
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:47:25Z',
 'fuel_type': 'petrol',
 'id': '17fcbdae-1902-5522-b6ca-a8d2f3691eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU38196',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 72881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-27',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2010}
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-29 20:36:58 [auto1.be] INFO: Saving data for WU38196: {'auction_closing_time': 1774885645.0, 'created_time': 1774298351.381626, 'last_price_update_time': 1774816618.64841}
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU38196') HTTP/1.1" 204 0
2026-03-29 20:36:58 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 20:36:58 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-29 20:36:58 [auto1.be] INFO: Scrape type for FC74189: 2
2026-03-29 20:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-29 20:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64420a0a-efcf-5a5e-9856-20d70760fb2c with scrape type 2
2026-03-29 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64420a0a-efcf-5a5e-9856-20d70760fb2c with scrape type 2
2026-03-29 20:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64420a0a-efcf-5a5e-9856-20d70760fb2c, identifier: FC74189
2026-03-29 20:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-29 20:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-29 20:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189 to the API
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:17:39Z',
 'fuel_type': 'petrol',
 'id': '64420a0a-efcf-5a5e-9856-20d70760fb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC74189',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 27592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Saving data for FC74189: {'auction_closing_time': 1774883859.0, 'created_time': 1774524937.946134, 'last_price_update_time': 1774816619.028957}
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC74189') HTTP/1.1" 204 0
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Scrape type for BR84638: 2
2026-03-29 20:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-29 20:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321116eb-2129-57ae-b68c-a7e210c6064e with scrape type 2
2026-03-29 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321116eb-2129-57ae-b68c-a7e210c6064e with scrape type 2
2026-03-29 20:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 321116eb-2129-57ae-b68c-a7e210c6064e, identifier: BR84638
2026-03-29 20:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 20:36:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-29 20:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638 to the API
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:59:11Z',
 'fuel_type': 'petrol',
 'id': '321116eb-2129-57ae-b68c-a7e210c6064e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR84638',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 119956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Saving data for BR84638: {'auction_closing_time': 1774886351.0, 'created_time': 1774611359.688212, 'last_price_update_time': 1774816619.601558}
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR84638') HTTP/1.1" 204 0
2026-03-29 20:36:59 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1260 | hits on page: 40
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 20:36:59 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-29 20:36:59 [auto1.be] INFO: Scrape type for CP13942: 2
2026-03-29 20:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-29 20:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4338ebf-0eaf-5282-8686-1617935d6bb1 with scrape type 2
2026-03-29 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4338ebf-0eaf-5282-8686-1617935d6bb1 with scrape type 2
2026-03-29 20:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4338ebf-0eaf-5282-8686-1617935d6bb1, identifier: CP13942
2026-03-29 20:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-29 20:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-29 20:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942 to the API
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:51Z',
 'fuel_type': 'petrol',
 'id': 'b4338ebf-0eaf-5282-8686-1617935d6bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP13942',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 132096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Saving data for CP13942: {'auction_closing_time': 1774885371.0, 'created_time': 1773136511.516096, 'last_price_update_time': 1774816620.091774}
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP13942') HTTP/1.1" 204 0
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Scrape type for RA65802: 2
2026-03-29 20:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-29 20:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd6db043-d074-5a67-b1c0-b31b974993e8 with scrape type 2
2026-03-29 20:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd6db043-d074-5a67-b1c0-b31b974993e8 with scrape type 2
2026-03-29 20:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd6db043-d074-5a67-b1c0-b31b974993e8, identifier: RA65802
2026-03-29 20:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-29 20:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-29 20:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802 to the API
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:49:28Z',
 'fuel_type': 'diesel',
 'id': 'cd6db043-d074-5a67-b1c0-b31b974993e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA65802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 193714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2019}
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Saving data for RA65802: {'auction_closing_time': 1774885768.0, 'created_time': 1773223878.480023, 'last_price_update_time': 1774816620.679571}
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA65802') HTTP/1.1" 204 0
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 20:37:00 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-29 20:37:00 [auto1.be] INFO: Scrape type for ZA01438: 2
2026-03-29 20:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-29 20:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with scrape type 2
2026-03-29 20:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with scrape type 2
2026-03-29 20:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fddc3a48-b91e-5192-9f45-8fee8ffc63d2, identifier: ZA01438
2026-03-29 20:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-29 20:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-29 20:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438 to the API
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'diesel',
 'id': 'fddc3a48-b91e-5192-9f45-8fee8ffc63d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA01438',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 198457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-11',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Saving data for ZA01438: {'auction_closing_time': 1774885289.0, 'created_time': 1774524981.495638, 'last_price_update_time': 1774816621.051351}
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZA01438') HTTP/1.1" 204 0
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Scrape type for PY58607: 2
2026-03-29 20:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-29 20:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26bf0e1-cb66-5112-9cb6-b13a24f193db with scrape type 2
2026-03-29 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d26bf0e1-cb66-5112-9cb6-b13a24f193db with scrape type 2
2026-03-29 20:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d26bf0e1-cb66-5112-9cb6-b13a24f193db, identifier: PY58607
2026-03-29 20:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-29 20:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-29 20:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607 to the API
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:28Z',
 'fuel_type': 'diesel',
 'id': 'd26bf0e1-cb66-5112-9cb6-b13a24f193db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY58607',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 155326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Standard',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Standard',
 'year': 2015}
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Saving data for PY58607: {'auction_closing_time': 1774886008.0, 'created_time': 1774643738.700245, 'last_price_update_time': 1774816621.544987}
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY58607') HTTP/1.1" 204 0
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 20:37:01 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Scrape type for XA29570: 2
2026-03-29 20:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-29 20:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72aa8770-46dd-5579-ac2c-097dda213bac with scrape type 2
2026-03-29 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72aa8770-46dd-5579-ac2c-097dda213bac with scrape type 2
2026-03-29 20:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 72aa8770-46dd-5579-ac2c-097dda213bac, identifier: XA29570
2026-03-29 20:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-29 20:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-29 20:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570 to the API
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'petrol',
 'id': '72aa8770-46dd-5579-ac2c-097dda213bac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA29570',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-07',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-29 20:37:01 [auto1.be] INFO: Saving data for XA29570: {'auction_closing_time': 1774884939.0, 'created_time': 1774643742.128975, 'last_price_update_time': 1774816621.986345}
2026-03-29 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XA29570') HTTP/1.1" 204 0
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-29 20:37:02 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:02 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-29 20:37:02 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-29 20:37:02 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-29 20:37:02 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-29 20:37:02 [auto1.be] INFO: Scrape type for XH49609: 2
2026-03-29 20:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-29 20:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec243356-4b5e-56a2-872a-716191b3a987 with scrape type 2
2026-03-29 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec243356-4b5e-56a2-872a-716191b3a987 with scrape type 2
2026-03-29 20:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec243356-4b5e-56a2-872a-716191b3a987, identifier: XH49609
2026-03-29 20:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-29 20:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-29 20:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609 to the API
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:47:38Z',
 'fuel_type': 'diesel',
 'id': 'ec243356-4b5e-56a2-872a-716191b3a987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH49609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'BMW 1er 114d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-29 20:37:03 [auto1.be] INFO: Saving data for XH49609: {'auction_closing_time': 1774885658.0, 'created_time': 1773238225.544476, 'last_price_update_time': 1774816623.07818}
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH49609') HTTP/1.1" 204 0
2026-03-29 20:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-29 20:37:03 [auto1.be] INFO: Scrape type for GV27154: 2
2026-03-29 20:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-29 20:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c972566e-1eff-57d5-a499-b4acc929719c with scrape type 2
2026-03-29 20:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c972566e-1eff-57d5-a499-b4acc929719c with scrape type 2
2026-03-29 20:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c972566e-1eff-57d5-a499-b4acc929719c, identifier: GV27154
2026-03-29 20:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-29 20:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-29 20:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154 to the API
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'diesel',
 'id': 'c972566e-1eff-57d5-a499-b4acc929719c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV27154',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 242398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-24',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-29 20:37:03 [auto1.be] INFO: Saving data for GV27154: {'auction_closing_time': 1774883547.0, 'created_time': 1773866349.363217, 'last_price_update_time': 1774816623.57988}
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV27154') HTTP/1.1" 204 0
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-29 20:37:03 [auto1.be] INFO: Scrape type for CR21244: 2
2026-03-29 20:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244
2026-03-29 20:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with scrape type 2
2026-03-29 20:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with scrape type 2
2026-03-29 20:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a, identifier: CR21244
2026-03-29 20:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244
2026-03-29 20:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244
2026-03-29 20:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244 to the API
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:01:34Z',
 'fuel_type': 'diesel',
 'id': 'e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR21244',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 123081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L3H2 Club Start&Stop',
 'transmission': 'manual',
 'trim': '33 L3H2 Club Start&Stop',
 'year': 2020}
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-29 20:37:03 [auto1.be] INFO: Saving data for CR21244: {'auction_closing_time': 1774882894.0, 'created_time': 1773384486.133218, 'last_price_update_time': 1774816623.973106}
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CR21244') HTTP/1.1" 204 0
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 20:37:03 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Scrape type for NM33768: 2
2026-03-29 20:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-29 20:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78516ba2-6b22-5a5b-a721-9293f0a07342 with scrape type 2
2026-03-29 20:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78516ba2-6b22-5a5b-a721-9293f0a07342 with scrape type 2
2026-03-29 20:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78516ba2-6b22-5a5b-a721-9293f0a07342, identifier: NM33768
2026-03-29 20:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-29 20:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-29 20:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768 to the API
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:46Z',
 'fuel_type': 'diesel',
 'id': '78516ba2-6b22-5a5b-a721-9293f0a07342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM33768',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 157935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 dCi Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2012}
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Saving data for NM33768: {'auction_closing_time': 1774885726.0, 'created_time': 1774611325.015862, 'last_price_update_time': 1774816624.386136}
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM33768') HTTP/1.1" 204 0
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Scrape type for BP38818: 2
2026-03-29 20:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-29 20:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with scrape type 2
2026-03-29 20:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with scrape type 2
2026-03-29 20:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75, identifier: BP38818
2026-03-29 20:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-29 20:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-29 20:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818 to the API
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:24Z',
 'fuel_type': 'petrol',
 'id': '4b9a3fff-8724-56ad-aedb-5f4bbe542c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP38818',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 147831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Saving data for BP38818: {'auction_closing_time': 1774886364.0, 'created_time': 1774524988.58517, 'last_price_update_time': 1774816624.871024}
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP38818') HTTP/1.1" 204 0
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 20:37:04 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-29 20:37:04 [auto1.be] INFO: Scrape type for AU41446: 2
2026-03-29 20:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-29 20:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with scrape type 2
2026-03-29 20:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with scrape type 2
2026-03-29 20:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6, identifier: AU41446
2026-03-29 20:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-29 20:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-29 20:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446 to the API
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:55:24Z',
 'fuel_type': 'petrol',
 'id': '78ea3ef9-b77e-5939-adfa-5f613fe9d2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU41446',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 100071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-02-12',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse 300 SE',
 'transmission': 'automatic',
 'trim': '',
 'year': 1992}
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Saving data for AU41446: {'auction_closing_time': 1774886124.0, 'created_time': 1774643739.900579, 'last_price_update_time': 1774816625.277407}
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU41446') HTTP/1.1" 204 0
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Scrape type for NJ59863: 2
2026-03-29 20:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-29 20:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with scrape type 2
2026-03-29 20:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with scrape type 2
2026-03-29 20:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e, identifier: NJ59863
2026-03-29 20:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-29 20:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-29 20:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863 to the API
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'petrol',
 'id': 'f3c38ce8-5ab1-56d2-80d8-4181e33ac78e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ59863',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 66923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'BMW 4er 420i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Saving data for NJ59863: {'auction_closing_time': 1774886369.0, 'created_time': 1774524927.251376, 'last_price_update_time': 1774816625.650897}
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ59863') HTTP/1.1" 204 0
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-29 20:37:05 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-29 20:37:05 [auto1.be] INFO: Scrape type for GH45635: 2
2026-03-29 20:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-29 20:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with scrape type 2
2026-03-29 20:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with scrape type 2
2026-03-29 20:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37, identifier: GH45635
2026-03-29 20:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-29 20:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-29 20:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635 to the API
2026-03-29 20:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-30T15:54:13Z',
 'fuel_type': 'hybrid',
 'id': '23257b69-fb1f-5cc3-8d02-79f3bcb2fc37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH45635',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 206000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-29 20:37:06 [auto1.be] INFO: Saving data for GH45635: {'auction_closing_time': 1774886053.0, 'created_time': 1773301934.312303, 'last_price_update_time': 1774816626.191638}
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH45635') HTTP/1.1" 204 0
2026-03-29 20:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:06 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-29 20:37:06 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-29 20:37:06 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 20:37:06 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-29 20:37:06 [auto1.be] INFO: Scrape type for SL51907: 2
2026-03-29 20:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-29 20:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094d12aa-415e-5ad0-b27b-d52674877643 with scrape type 2
2026-03-29 20:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 094d12aa-415e-5ad0-b27b-d52674877643 with scrape type 2
2026-03-29 20:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 094d12aa-415e-5ad0-b27b-d52674877643, identifier: SL51907
2026-03-29 20:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 20:37:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-29 20:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907 to the API
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:55:50Z',
 'fuel_type': 'diesel',
 'id': '094d12aa-415e-5ad0-b27b-d52674877643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL51907',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 202104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Saving data for SL51907: {'auction_closing_time': 1774886150.0, 'created_time': 1773866476.957817, 'last_price_update_time': 1774816627.035344}
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL51907') HTTP/1.1" 204 0
2026-03-29 20:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for JW78855: 2
2026-03-29 20:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-29 20:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with scrape type 2
2026-03-29 20:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with scrape type 2
2026-03-29 20:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8, identifier: JW78855
2026-03-29 20:37:07 [scrapy.extensions.logstats] INFO: Crawled 26 pages (at 13 pages/min), scraped 158 items (at 113 items/min)
2026-03-29 20:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 20:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-29 20:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-29 20:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855 to the API
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:31:23Z',
 'fuel_type': 'petrol',
 'id': '5aab7a44-8f6d-5835-a2c6-84417fec9eb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW78855',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 155220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Saving data for JW78855: {'auction_closing_time': 1774884683.0, 'created_time': 1774524937.054344, 'last_price_update_time': 1774816627.462267}
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW78855') HTTP/1.1" 204 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 20:37:07 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-29 20:37:07 [auto1.be] INFO: Scrape type for WS04459: 2
2026-03-29 20:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-29 20:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c4374bf-0d03-5ed8-bb70-d50388a9707d with scrape type 2
2026-03-29 20:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c4374bf-0d03-5ed8-bb70-d50388a9707d with scrape type 2
2026-03-29 20:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c4374bf-0d03-5ed8-bb70-d50388a9707d, identifier: WS04459
2026-03-29 20:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-29 20:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-29 20:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459 to the API
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:10:24Z',
 'fuel_type': 'diesel',
 'id': '1c4374bf-0d03-5ed8-bb70-d50388a9707d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS04459',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 180366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Exceed',
 'transmission': 'automatic',
 'trim': 'Exceed',
 'year': 2017}
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-29 20:37:08 [auto1.be] INFO: Saving data for WS04459: {'auction_closing_time': 1774883424.0, 'created_time': 1773434395.222802, 'last_price_update_time': 1774816628.038471}
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WS04459') HTTP/1.1" 204 0
2026-03-29 20:37:08 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-29 20:37:08 [auto1.be] INFO: Scrape type for KS43499: 2
2026-03-29 20:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-29 20:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with scrape type 2
2026-03-29 20:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with scrape type 2
2026-03-29 20:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08, identifier: KS43499
2026-03-29 20:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-29 20:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-29 20:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499 to the API
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:18Z',
 'fuel_type': 'diesel',
 'id': 'c1a8fcfc-4ac9-5924-a6e7-6309db30fa08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS43499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-29 20:37:08 [auto1.be] INFO: Saving data for KS43499: {'auction_closing_time': 1774885998.0, 'created_time': 1774524950.490951, 'last_price_update_time': 1774816628.524408}
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS43499') HTTP/1.1" 204 0
2026-03-29 20:37:08 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 20:37:08 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-29 20:37:08 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-29 20:37:08 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 20:37:08 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-29 20:37:08 [auto1.be] INFO: Scrape type for BZ65544: 2
2026-03-29 20:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544
2026-03-29 20:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with scrape type 2
2026-03-29 20:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with scrape type 2
2026-03-29 20:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d, identifier: BZ65544
2026-03-29 20:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544
2026-03-29 20:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544
2026-03-29 20:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544 to the API
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:42:55Z',
 'fuel_type': 'petrol',
 'id': '16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ65544',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 78105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'Ford Kuga 1.6 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-29 20:37:08 [auto1.be] INFO: Saving data for BZ65544: {'auction_closing_time': 1774885375.0, 'created_time': 1774514153.935643, 'last_price_update_time': 1774816628.997743}
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ65544') HTTP/1.1" 204 0
2026-03-29 20:37:09 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-29 20:37:09 [auto1.be] INFO: Scrape type for HZ19238: 2
2026-03-29 20:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-29 20:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with scrape type 2
2026-03-29 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with scrape type 2
2026-03-29 20:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4ec37d8-52a1-5835-98e4-ea91f3cfd042, identifier: HZ19238
2026-03-29 20:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-29 20:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-29 20:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238 to the API
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:34:27Z',
 'fuel_type': 'diesel',
 'id': 'e4ec37d8-52a1-5835-98e4-ea91f3cfd042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ19238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 182429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-29 20:37:09 [auto1.be] INFO: Saving data for HZ19238: {'auction_closing_time': 1774884867.0, 'created_time': 1774524979.197727, 'last_price_update_time': 1774816629.358458}
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ19238') HTTP/1.1" 204 0
2026-03-29 20:37:09 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 20:37:09 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 20:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:10 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:10 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-29 20:37:10 [auto1.be] INFO: Scrape type for AT20959: 2
2026-03-29 20:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959
2026-03-29 20:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c663418-20d3-518c-bc61-1c9cda53c239 with scrape type 2
2026-03-29 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c663418-20d3-518c-bc61-1c9cda53c239 with scrape type 2
2026-03-29 20:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c663418-20d3-518c-bc61-1c9cda53c239, identifier: AT20959
2026-03-29 20:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959
2026-03-29 20:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959
2026-03-29 20:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959 to the API
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:38Z',
 'fuel_type': 'diesel',
 'id': '2c663418-20d3-518c-bc61-1c9cda53c239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT20959',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 109002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2015}
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-29 20:37:10 [auto1.be] INFO: Saving data for AT20959: {'auction_closing_time': 1774883318.0, 'created_time': 1774730214.660005, 'last_price_update_time': 1774816630.787828}
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AT20959') HTTP/1.1" 204 0
2026-03-29 20:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:10 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-29 20:37:10 [auto1.be] INFO: Scrape type for JM34078: 2
2026-03-29 20:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-29 20:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89490faf-3f29-50b7-b5e6-da3866bc8354 with scrape type 2
2026-03-29 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89490faf-3f29-50b7-b5e6-da3866bc8354 with scrape type 2
2026-03-29 20:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89490faf-3f29-50b7-b5e6-da3866bc8354, identifier: JM34078
2026-03-29 20:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-29 20:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-29 20:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078 to the API
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:17:07Z',
 'fuel_type': 'diesel',
 'id': '89490faf-3f29-50b7-b5e6-da3866bc8354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM34078',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 198206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L2H1 3,0t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 3,0t',
 'year': 2018}
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Saving data for JM34078: {'auction_closing_time': 1774883827.0, 'created_time': 1774611362.735349, 'last_price_update_time': 1774816631.214186}
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM34078') HTTP/1.1" 204 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for UW48678: 2
2026-03-29 20:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678
2026-03-29 20:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee790633-e426-568c-aa57-a78c4bccbd87 with scrape type 2
2026-03-29 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee790633-e426-568c-aa57-a78c4bccbd87 with scrape type 2
2026-03-29 20:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee790633-e426-568c-aa57-a78c4bccbd87, identifier: UW48678
2026-03-29 20:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678
2026-03-29 20:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678
2026-03-29 20:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678 to the API
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:13Z',
 'fuel_type': 'diesel',
 'id': 'ee790633-e426-568c-aa57-a78c4bccbd87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW48678',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 157231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Saving data for UW48678: {'auction_closing_time': 1774884013.0, 'created_time': 1774514148.987244, 'last_price_update_time': 1774816631.663567}
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW48678') HTTP/1.1" 204 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 20:37:11 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-29 20:37:11 [auto1.be] INFO: Scrape type for LC46636: 2
2026-03-29 20:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-29 20:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254735c0-f192-5a60-ba4c-80af7ce6e950 with scrape type 2
2026-03-29 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 254735c0-f192-5a60-ba4c-80af7ce6e950 with scrape type 2
2026-03-29 20:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 254735c0-f192-5a60-ba4c-80af7ce6e950, identifier: LC46636
2026-03-29 20:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-29 20:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-29 20:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636 to the API
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:04:26Z',
 'fuel_type': 'petrol',
 'id': '254735c0-f192-5a60-ba4c-80af7ce6e950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC46636',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 97233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-29 20:37:12 [auto1.be] INFO: Saving data for LC46636: {'auction_closing_time': 1774883066.0, 'created_time': 1774611390.43872, 'last_price_update_time': 1774816632.212795}
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LC46636') HTTP/1.1" 204 0
2026-03-29 20:37:12 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 20:37:12 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 20:37:12 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-29 20:37:12 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-29 20:37:12 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-29 20:37:12 [auto1.be] INFO: Scrape type for SC73086: 2
2026-03-29 20:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-29 20:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b44c9a68-462c-59cc-842a-a42a634a4c4d with scrape type 2
2026-03-29 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b44c9a68-462c-59cc-842a-a42a634a4c4d with scrape type 2
2026-03-29 20:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b44c9a68-462c-59cc-842a-a42a634a4c4d, identifier: SC73086
2026-03-29 20:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-29 20:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-29 20:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086 to the API
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:15:58Z',
 'fuel_type': 'petrol',
 'id': 'b44c9a68-462c-59cc-842a-a42a634a4c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC73086',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 136155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-19',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2014}
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-29 20:37:12 [auto1.be] INFO: Saving data for SC73086: {'auction_closing_time': 1774883758.0, 'created_time': 1774298364.450341, 'last_price_update_time': 1774816632.642572}
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC73086') HTTP/1.1" 204 0
2026-03-29 20:37:12 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 20:37:12 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-29 20:37:12 [auto1.be] INFO: Scrape type for NN69701: 2
2026-03-29 20:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-29 20:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e9cd131-57c2-59bf-959c-55bb706fbfcd with scrape type 2
2026-03-29 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e9cd131-57c2-59bf-959c-55bb706fbfcd with scrape type 2
2026-03-29 20:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e9cd131-57c2-59bf-959c-55bb706fbfcd, identifier: NN69701
2026-03-29 20:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-29 20:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-29 20:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701 to the API
2026-03-29 20:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:56:10Z',
 'fuel_type': 'diesel',
 'id': '7e9cd131-57c2-59bf-959c-55bb706fbfcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN69701',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 207612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-23',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Saving data for NN69701: {'auction_closing_time': 1774886170.0, 'created_time': 1774643742.489224, 'last_price_update_time': 1774816633.102719}
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN69701') HTTP/1.1" 204 0
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Scrape type for FU04844: 2
2026-03-29 20:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-29 20:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c421c59-071e-592e-a41d-dd19b15f57db with scrape type 2
2026-03-29 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c421c59-071e-592e-a41d-dd19b15f57db with scrape type 2
2026-03-29 20:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c421c59-071e-592e-a41d-dd19b15f57db, identifier: FU04844
2026-03-29 20:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 20:37:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-29 20:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844 to the API
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:37:41Z',
 'fuel_type': 'petrol',
 'id': '7c421c59-071e-592e-a41d-dd19b15f57db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU04844',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 127728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 FSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Saving data for FU04844: {'auction_closing_time': 1774885061.0, 'created_time': 1774524983.175024, 'last_price_update_time': 1774816633.656102}
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FU04844') HTTP/1.1" 204 0
2026-03-29 20:37:13 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-29 20:37:13 [auto1.be] INFO: Scrape type for FC28385: 2
2026-03-29 20:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-29 20:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e066583-a6d5-54c4-9ace-e3e906348de6 with scrape type 2
2026-03-29 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e066583-a6d5-54c4-9ace-e3e906348de6 with scrape type 2
2026-03-29 20:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e066583-a6d5-54c4-9ace-e3e906348de6, identifier: FC28385
2026-03-29 20:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-29 20:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-29 20:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385 to the API
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:43Z',
 'fuel_type': 'petrol',
 'id': '5e066583-a6d5-54c4-9ace-e3e906348de6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC28385',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-07',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-29 20:37:14 [auto1.be] INFO: Saving data for FC28385: {'auction_closing_time': 1774882843.0, 'created_time': 1773134409.180453, 'last_price_update_time': 1774816634.065358}
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28385') HTTP/1.1" 204 0
2026-03-29 20:37:14 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 20:37:14 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-29 20:37:14 [auto1.be] INFO: Scrape type for UM95648: 2
2026-03-29 20:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-29 20:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eee887d9-6deb-5308-8e85-31dd9eb664cc with scrape type 2
2026-03-29 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eee887d9-6deb-5308-8e85-31dd9eb664cc with scrape type 2
2026-03-29 20:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eee887d9-6deb-5308-8e85-31dd9eb664cc, identifier: UM95648
2026-03-29 20:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-29 20:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-29 20:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648 to the API
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:30Z',
 'fuel_type': 'diesel',
 'id': 'eee887d9-6deb-5308-8e85-31dd9eb664cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM95648',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 165535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-29 20:37:14 [auto1.be] INFO: Saving data for UM95648: {'auction_closing_time': 1774884990.0, 'created_time': 1774524922.388539, 'last_price_update_time': 1774816634.561217}
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM95648') HTTP/1.1" 204 0
2026-03-29 20:37:14 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-29 20:37:14 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-29 20:37:14 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 20:37:14 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-29 20:37:14 [auto1.be] INFO: Scrape type for LG02466: 2
2026-03-29 20:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-29 20:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79734c8b-9629-5726-8cb7-c47685c96b21 with scrape type 2
2026-03-29 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79734c8b-9629-5726-8cb7-c47685c96b21 with scrape type 2
2026-03-29 20:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79734c8b-9629-5726-8cb7-c47685c96b21, identifier: LG02466
2026-03-29 20:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-29 20:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-29 20:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466 to the API
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:51:39Z',
 'fuel_type': 'diesel',
 'id': '79734c8b-9629-5726-8cb7-c47685c96b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG02466',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 237146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2018}
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-29 20:37:14 [auto1.be] INFO: Saving data for LG02466: {'auction_closing_time': 1774885899.0, 'created_time': 1773239710.677546, 'last_price_update_time': 1774816634.986636}
2026-03-29 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG02466') HTTP/1.1" 204 0
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 20:37:15 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-29 20:37:15 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-29 20:37:15 [auto1.be] INFO: Scrape type for DD08232: 2
2026-03-29 20:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232
2026-03-29 20:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with scrape type 2
2026-03-29 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with scrape type 2
2026-03-29 20:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abbc6770-4925-5e9c-9ab1-3c1745cadbc2, identifier: DD08232
2026-03-29 20:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232
2026-03-29 20:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232
2026-03-29 20:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232 to the API
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:06:14Z',
 'fuel_type': 'diesel',
 'id': 'abbc6770-4925-5e9c-9ab1-3c1745cadbc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD08232',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 232476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-29 20:37:15 [auto1.be] INFO: Saving data for DD08232: {'auction_closing_time': 1774883174.0, 'created_time': 1774125396.370517, 'last_price_update_time': 1774816635.408726}
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD08232') HTTP/1.1" 204 0
2026-03-29 20:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-29 20:37:15 [auto1.be] INFO: Scrape type for VA33507: 2
2026-03-29 20:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-29 20:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9602a68-0826-50df-9626-ca57389c77f7 with scrape type 2
2026-03-29 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9602a68-0826-50df-9626-ca57389c77f7 with scrape type 2
2026-03-29 20:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9602a68-0826-50df-9626-ca57389c77f7, identifier: VA33507
2026-03-29 20:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-29 20:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-29 20:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507 to the API
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:20Z',
 'fuel_type': 'diesel',
 'id': 'e9602a68-0826-50df-9626-ca57389c77f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA33507',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 179135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-29 20:37:15 [auto1.be] INFO: Saving data for VA33507: {'auction_closing_time': 1774883840.0, 'created_time': 1773138050.607634, 'last_price_update_time': 1774816635.809915}
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA33507') HTTP/1.1" 204 0
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 20:37:15 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-29 20:37:15 [auto1.be] INFO: Scrape type for LY58233: 2
2026-03-29 20:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-29 20:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e38bf0c-6944-5305-b783-d2f785623c95 with scrape type 2
2026-03-29 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e38bf0c-6944-5305-b783-d2f785623c95 with scrape type 2
2026-03-29 20:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e38bf0c-6944-5305-b783-d2f785623c95, identifier: LY58233
2026-03-29 20:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-29 20:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-29 20:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233 to the API
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'hybrid',
 'id': '4e38bf0c-6944-5305-b783-d2f785623c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY58233',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 190058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-29 20:37:16 [auto1.be] INFO: Saving data for LY58233: {'auction_closing_time': 1774885382.0, 'created_time': 1774524986.725315, 'last_price_update_time': 1774816636.303608}
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY58233') HTTP/1.1" 204 0
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-29 20:37:16 [auto1.be] INFO: Scrape type for XH30316: 2
2026-03-29 20:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-29 20:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee85060-27dd-5afa-b939-7b47d18b1efe with scrape type 2
2026-03-29 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee85060-27dd-5afa-b939-7b47d18b1efe with scrape type 2
2026-03-29 20:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bee85060-27dd-5afa-b939-7b47d18b1efe, identifier: XH30316
2026-03-29 20:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-29 20:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-29 20:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316 to the API
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:42Z',
 'fuel_type': 'diesel',
 'id': 'bee85060-27dd-5afa-b939-7b47d18b1efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH30316',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 199358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-03',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-29 20:37:16 [auto1.be] INFO: Saving data for XH30316: {'auction_closing_time': 1774885542.0, 'created_time': 1774125442.068833, 'last_price_update_time': 1774816636.80504}
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH30316') HTTP/1.1" 204 0
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-29 20:37:16 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 20:37:16 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-29 20:37:16 [auto1.be] INFO: Scrape type for PU90284: 2
2026-03-29 20:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-29 20:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with scrape type 2
2026-03-29 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with scrape type 2
2026-03-29 20:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8abb6001-164c-5d9d-9ae1-286dc8a366f2, identifier: PU90284
2026-03-29 20:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-29 20:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-29 20:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284 to the API
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:56Z',
 'fuel_type': 'petrol',
 'id': '8abb6001-164c-5d9d-9ae1-286dc8a366f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90284',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Saving data for PU90284: {'auction_closing_time': 1774883696.0, 'created_time': 1773301732.687763, 'last_price_update_time': 1774816637.23516}
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PU90284') HTTP/1.1" 204 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-29 20:37:17 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Scrape type for KG87325: 2
2026-03-29 20:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-29 20:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with scrape type 2
2026-03-29 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with scrape type 2
2026-03-29 20:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9aa4639-2eaf-5832-a89a-6c46f6cc5691, identifier: KG87325
2026-03-29 20:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-29 20:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-29 20:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325 to the API
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'hybrid',
 'id': 'f9aa4639-2eaf-5832-a89a-6c46f6cc5691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG87325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 12326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-29 20:37:17 [auto1.be] INFO: Saving data for KG87325: {'auction_closing_time': 1774886010.0, 'created_time': 1773779734.955477, 'last_price_update_time': 1774816637.967739}
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG87325') HTTP/1.1" 204 0
2026-03-29 20:37:18 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-29 20:37:18 [auto1.be] INFO: Scrape type for HU17820: 2
2026-03-29 20:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820
2026-03-29 20:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with scrape type 2
2026-03-29 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with scrape type 2
2026-03-29 20:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e303cf21-b14a-5dac-b1c9-cb7c7fec6526, identifier: HU17820
2026-03-29 20:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820
2026-03-29 20:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820
2026-03-29 20:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820 to the API
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'petrol',
 'id': 'e303cf21-b14a-5dac-b1c9-cb7c7fec6526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU17820',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 82386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-29 20:37:18 [auto1.be] INFO: Saving data for HU17820: {'auction_closing_time': 1774885296.0, 'created_time': 1774730223.347914, 'last_price_update_time': 1774816638.420414}
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU17820') HTTP/1.1" 204 0
2026-03-29 20:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:18 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:18 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 20:37:18 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-29 20:37:18 [auto1.be] INFO: Scrape type for NV75936: 2
2026-03-29 20:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936
2026-03-29 20:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e987b171-1c55-5ba2-9698-9295cd6d0a23 with scrape type 2
2026-03-29 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e987b171-1c55-5ba2-9698-9295cd6d0a23 with scrape type 2
2026-03-29 20:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e987b171-1c55-5ba2-9698-9295cd6d0a23, identifier: NV75936
2026-03-29 20:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936
2026-03-29 20:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936
2026-03-29 20:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936 to the API
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:14:09Z',
 'fuel_type': 'diesel',
 'id': 'e987b171-1c55-5ba2-9698-9295cd6d0a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV75936',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 82166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2022}
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-29 20:37:19 [auto1.be] INFO: Saving data for NV75936: {'auction_closing_time': 1774883649.0, 'created_time': 1774730219.483211, 'last_price_update_time': 1774816639.018071}
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV75936') HTTP/1.1" 204 0
2026-03-29 20:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-29 20:37:19 [auto1.be] INFO: Scrape type for AW25378: 2
2026-03-29 20:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378
2026-03-29 20:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce with scrape type 2
2026-03-29 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce with scrape type 2
2026-03-29 20:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d4fb1c7-c573-568e-8b4d-3519d53218ce, identifier: AW25378
2026-03-29 20:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378
2026-03-29 20:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378
2026-03-29 20:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378 to the API
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:08Z',
 'fuel_type': 'petrol',
 'id': '3d4fb1c7-c573-568e-8b4d-3519d53218ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW25378',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 169392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-11',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-29 20:37:19 [auto1.be] INFO: Saving data for AW25378: {'auction_closing_time': 1774884848.0, 'created_time': 1774730222.257239, 'last_price_update_time': 1774816639.439108}
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AW25378') HTTP/1.1" 204 0
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-29 20:37:19 [auto1.be] INFO: Scrape type for LS82290: 2
2026-03-29 20:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290
2026-03-29 20:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a7bd18-5699-5f63-8c35-900f8c09917a with scrape type 2
2026-03-29 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0a7bd18-5699-5f63-8c35-900f8c09917a with scrape type 2
2026-03-29 20:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0a7bd18-5699-5f63-8c35-900f8c09917a, identifier: LS82290
2026-03-29 20:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290
2026-03-29 20:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290
2026-03-29 20:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290 to the API
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:42Z',
 'fuel_type': 'petrol',
 'id': 'b0a7bd18-5699-5f63-8c35-900f8c09917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS82290',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 74189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2020}
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-29 20:37:19 [auto1.be] INFO: Saving data for LS82290: {'auction_closing_time': 1774886202.0, 'created_time': 1774730221.457827, 'last_price_update_time': 1774816639.842232}
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LS82290') HTTP/1.1" 204 0
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 20:37:19 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-29 20:37:19 [auto1.be] INFO: Scrape type for CM51817: 2
2026-03-29 20:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817
2026-03-29 20:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb6f833-2633-5bb6-b91b-a5472789db91 with scrape type 2
2026-03-29 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb6f833-2633-5bb6-b91b-a5472789db91 with scrape type 2
2026-03-29 20:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcb6f833-2633-5bb6-b91b-a5472789db91, identifier: CM51817
2026-03-29 20:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817
2026-03-29 20:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817
2026-03-29 20:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817 to the API
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'diesel',
 'id': 'dcb6f833-2633-5bb6-b91b-a5472789db91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM51817',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 136045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2015}
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Saving data for CM51817: {'auction_closing_time': 1774883752.0, 'created_time': 1774730218.400918, 'last_price_update_time': 1774816640.22688}
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM51817') HTTP/1.1" 204 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for RD23593: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for GD95033: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for LG99308: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for KW17867: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for HS15781: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for HT80629: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for FT23017: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for MY75694: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for LH19076: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for FT86060: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for TF49476: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for JT63704: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for SX16585: 0
2026-03-29 20:37:20 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-29 20:37:20 [auto1.be] INFO: Scrape type for TF43790: 0
2026-03-29 20:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:21 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for LF44164: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for SV00163: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for VM07385: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for WC19794: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for SB51494: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for KM81672: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for JC37428: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for BT48733: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for JM52918: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for PJ47204: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for WV93881: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for WV93759: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for HZ76034: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for US61524: 0
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 20:37:21 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-29 20:37:21 [auto1.be] INFO: Scrape type for WJ93890: 0
2026-03-29 20:37:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:22 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:22 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for DN00999: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for ZW40078: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for YW96446: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for UE64828: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for KF94293: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for LM13926: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for AE63964: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for SL57288: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for RK43455: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for FB93927: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for SV46049: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for WV65314: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for FM81572: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for MW50956: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for DN28044: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for WG38275: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for NC08569: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for CF30779: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for WT53046: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for DR48094: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for JZ34939: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for TX04561: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for BC33060: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for EP00364: 0
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 20:37:23 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-29 20:37:23 [auto1.be] INFO: Scrape type for HB59214: 0
2026-03-29 20:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:24 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for SX95001: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for UR33188: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for FJ57746: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for KZ05274: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for HK87235: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for CD22470: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for SJ05954: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for FV90992: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for PG48700: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for DC62563: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for ZP95092: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for ZR35447: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for CA54828: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for FW70524: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for NZ74768: 0
2026-03-29 20:37:24 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-29 20:37:24 [auto1.be] INFO: Scrape type for AC55620: 0
2026-03-29 20:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:25 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-29 20:37:25 [auto1.be] INFO: Scrape type for YZ92764: 0
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-29 20:37:25 [auto1.be] INFO: Scrape type for ZZ63767: 0
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-29 20:37:25 [auto1.be] INFO: Scrape type for VW23905: 0
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-29 20:37:25 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-29 20:37:25 [auto1.be] INFO: Scrape type for XC95069: 0
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-29 20:37:25 [auto1.be] INFO: Scrape type for BS70441: 0
2026-03-29 20:37:25 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for GM14941: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for SY87797: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for ZV95387: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for KB40459: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for ZZ39097: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for SC10935: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for BU18930: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for CN37182: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for EK79460: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for KE51169: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for XS76018: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for UY92003: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for NV64774: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for ET88330: 0
2026-03-29 20:37:26 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-29 20:37:26 [auto1.be] INFO: Scrape type for KT00341: 0
2026-03-29 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:27 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for YH90615: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for CU35051: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for PK02246: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for LY17098: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for FC78029: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for EH00335: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for WH49963: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for KL53758: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for RA73981: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for EJ96142: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for HE39793: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for DD83263: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for SW21472: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-29 20:37:27 [auto1.be] INFO: Scrape type for EY57880: 0
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 20:37:27 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for ZN56944: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for HX50025: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for DH53723: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for RD62823: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for ZG72967: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for UH00217: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for JY01361: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for EU75132: 0
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 20:37:28 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-29 20:37:28 [auto1.be] INFO: Scrape type for FK09845: 0
2026-03-29 20:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:29 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1260 | hits on page: 40
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for EB31921: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for DJ63605: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for TC61218: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for PP72448: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for EV21741: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for BZ95673: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for AG16412: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for TM16327: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for UC18604: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-29 20:37:29 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-29 20:37:29 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-29 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:30 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1260 | hits on page: 20
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-29 20:37:30 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-29 20:37:30 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 20:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 20:37:31 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1260 | hits on page: 0
2026-03-29 20:37:31 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 20:37:31 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-29 20:37:31 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 153, <ScrapeType.BATCH_SKIPPED: 5>: 137}
2026-03-29 20:37:32 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (184 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-29T20_35_00.jl
2026-03-29 20:37:32 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 102711,
 'downloader/request_count': 37,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 35,
 'downloader/response_bytes': 5947830,
 'downloader/response_count': 37,
 'downloader/response_status_count/200': 37,
 'elapsed_time_seconds': 145.584242,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 20, 37, 32, 199164, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 184,
 'log_count/DEBUG': 2703,
 'log_count/INFO': 3512,
 'memusage/max': 165285888,
 'memusage/startup': 149880832,
 'request_depth_max': 36,
 'response_received_count': 37,
 'scheduler/dequeued': 37,
 'scheduler/dequeued/memory': 37,
 'scheduler/enqueued': 37,
 'scheduler/enqueued/memory': 37,
 'scrape_type/batch_skipped': 653,
 'scrape_type/price_update': 184,
 'scrape_type/skipped': 463,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 37,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.013623701635043,
 'scrapy-zyte-api/mean_response_seconds': 3.0988807067325395,
 'scrapy-zyte-api/processed': 37,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 37,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 36,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 37,
 'scrapy-zyte-api/request_args/httpRequestBody': 35,
 'scrapy-zyte-api/request_args/httpRequestMethod': 35,
 'scrapy-zyte-api/request_args/httpResponseBody': 37,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 37,
 'scrapy-zyte-api/request_args/sessionContext': 37,
 'scrapy-zyte-api/request_args/url': 37,
 'scrapy-zyte-api/status_codes/200': 37,
 'scrapy-zyte-api/success': 37,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1300,
 'source/total_available': 1260,
 'start_time': datetime.datetime(2026, 3, 29, 20, 35, 6, 614922, tzinfo=datetime.timezone.utc)}
2026-03-29 20:37:32 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 20:37:32 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f05d2162d50>
2026-03-29 20:37:32 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f05d2134650>