2026-03-30 06:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 06:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 06:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-30 06:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-30 06:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 06:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 06:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 06:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 06:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: a03225b045175370
2026-03-30 06:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 06:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-30T06_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 06:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 06:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 06:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 06:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 06:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 06:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 06:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 06:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 06:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 06:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 06:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 06:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 06:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 06:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 06:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 06:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 06:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 06:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 06:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 06:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 06:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 06:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 06:35:17 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:17 [auto1.be] INFO: Found listing with ID: FG04950
2026-03-30 06:35:17 [auto1.be] INFO: Found listing with ID: SR54305
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR54305%27 HTTP/1.1" 200 None
2026-03-30 06:35:17 [auto1.be] INFO: Scrape type for SR54305: 2
2026-03-30 06:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5 with identifier: SR54305
2026-03-30 06:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5 with scrape type 2
2026-03-30 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5 with scrape type 2
2026-03-30 06:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5, identifier: SR54305
2026-03-30 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5 with identifier: SR54305
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5 with identifier: SR54305
2026-03-30 06:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ba767ca-6162-5f8e-bdf4-ffb841bc73a5 with identifier: SR54305 to the API
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:41:00Z',
 'fuel_type': 'diesel',
 'id': '3ba767ca-6162-5f8e-bdf4-ffb841bc73a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR54305',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 166103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-23',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR54305%27 HTTP/1.1" 200 None
2026-03-30 06:35:17 [auto1.be] INFO: Saving data for SR54305: {'auction_closing_time': 1774971660.0, 'created_time': 1773132994.223889, 'last_price_update_time': 1774852517.799422}
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR54305') HTTP/1.1" 204 0
2026-03-30 06:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:17 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM64227%27 HTTP/1.1" 200 None
2026-03-30 06:35:17 [auto1.be] INFO: Scrape type for HM64227: 1
2026-03-30 06:35:17 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 06:35:17 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-30 06:35:17 [auto1.be] INFO: Scrape type for XN45926: 2
2026-03-30 06:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926
2026-03-30 06:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5497cd11-5fb6-55a6-b576-674e59e137dc with scrape type 2
2026-03-30 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5497cd11-5fb6-55a6-b576-674e59e137dc with scrape type 2
2026-03-30 06:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5497cd11-5fb6-55a6-b576-674e59e137dc, identifier: XN45926
2026-03-30 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926
2026-03-30 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926
2026-03-30 06:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926 to the API
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:14:05Z',
 'fuel_type': 'petrol',
 'id': '5497cd11-5fb6-55a6-b576-674e59e137dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN45926',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 81921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Elle',
 'transmission': 'manual',
 'trim': 'Elle',
 'year': 2018}
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-30 06:35:18 [auto1.be] INFO: Saving data for XN45926: {'auction_closing_time': 1774970045.0, 'created_time': 1773134067.788698, 'last_price_update_time': 1774852518.513539}
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN45926') HTTP/1.1" 204 0
2026-03-30 06:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:18 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 06:35:18 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ73226%27 HTTP/1.1" 200 None
2026-03-30 06:35:18 [auto1.be] INFO: Scrape type for MJ73226: 2
2026-03-30 06:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ae6440-862f-595f-9456-7daf27efb832 with identifier: MJ73226
2026-03-30 06:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ae6440-862f-595f-9456-7daf27efb832 with scrape type 2
2026-03-30 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0ae6440-862f-595f-9456-7daf27efb832 with scrape type 2
2026-03-30 06:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0ae6440-862f-595f-9456-7daf27efb832, identifier: MJ73226
2026-03-30 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0ae6440-862f-595f-9456-7daf27efb832 with identifier: MJ73226
2026-03-30 06:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0ae6440-862f-595f-9456-7daf27efb832 with identifier: MJ73226
2026-03-30 06:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0ae6440-862f-595f-9456-7daf27efb832 with identifier: MJ73226 to the API
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:36:33Z',
 'fuel_type': 'petrol',
 'id': 'd0ae6440-862f-595f-9456-7daf27efb832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ73226',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 84803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2018}
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ73226%27 HTTP/1.1" 200 None
2026-03-30 06:35:18 [auto1.be] INFO: Saving data for MJ73226: {'auction_closing_time': 1774971393.0, 'created_time': 1773693362.747834, 'last_price_update_time': 1774852518.987242}
2026-03-30 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ73226') HTTP/1.1" 204 0
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-30 06:35:19 [auto1.be] INFO: Scrape type for TF58036: 2
2026-03-30 06:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036
2026-03-30 06:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a5c319-9284-5962-b60b-a93cbc7a19b9 with scrape type 2
2026-03-30 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a5c319-9284-5962-b60b-a93cbc7a19b9 with scrape type 2
2026-03-30 06:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7a5c319-9284-5962-b60b-a93cbc7a19b9, identifier: TF58036
2026-03-30 06:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036
2026-03-30 06:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036
2026-03-30 06:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036 to the API
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:05:36Z',
 'fuel_type': 'diesel',
 'id': 'b7a5c319-9284-5962-b60b-a93cbc7a19b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF58036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 202139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-09',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2017}
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-30 06:35:19 [auto1.be] INFO: Saving data for TF58036: {'auction_closing_time': 1774969536.0, 'created_time': 1774514169.588226, 'last_price_update_time': 1774852519.447226}
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF58036') HTTP/1.1" 204 0
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS35098%27 HTTP/1.1" 200 None
2026-03-30 06:35:19 [auto1.be] INFO: Scrape type for GS35098: 1
2026-03-30 06:35:19 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS14605%27 HTTP/1.1" 200 None
2026-03-30 06:35:19 [auto1.be] INFO: Scrape type for BS14605: 2
2026-03-30 06:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77b777ab-82ee-5640-a336-4575a36b4826 with identifier: BS14605
2026-03-30 06:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77b777ab-82ee-5640-a336-4575a36b4826 with scrape type 2
2026-03-30 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77b777ab-82ee-5640-a336-4575a36b4826 with scrape type 2
2026-03-30 06:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77b777ab-82ee-5640-a336-4575a36b4826, identifier: BS14605
2026-03-30 06:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77b777ab-82ee-5640-a336-4575a36b4826 with identifier: BS14605
2026-03-30 06:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77b777ab-82ee-5640-a336-4575a36b4826 with identifier: BS14605
2026-03-30 06:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77b777ab-82ee-5640-a336-4575a36b4826 with identifier: BS14605 to the API
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:32:42Z',
 'fuel_type': 'diesel',
 'id': '77b777ab-82ee-5640-a336-4575a36b4826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS14605',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 232364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-01',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t',
 'year': 2013}
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS14605%27 HTTP/1.1" 200 None
2026-03-30 06:35:20 [auto1.be] INFO: Saving data for BS14605: {'auction_closing_time': 1774971162.0, 'created_time': 1774125437.382027, 'last_price_update_time': 1774852520.019335}
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS14605') HTTP/1.1" 204 0
2026-03-30 06:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:20 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 06:35:20 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 06:35:20 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN20180%27 HTTP/1.1" 200 None
2026-03-30 06:35:20 [auto1.be] INFO: Scrape type for JN20180: 1
2026-03-30 06:35:20 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78085%27 HTTP/1.1" 200 None
2026-03-30 06:35:20 [auto1.be] INFO: Scrape type for XG78085: 2
2026-03-30 06:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c27382-958e-5a57-a374-cc5bbf9bb107 with identifier: XG78085
2026-03-30 06:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c27382-958e-5a57-a374-cc5bbf9bb107 with scrape type 2
2026-03-30 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c27382-958e-5a57-a374-cc5bbf9bb107 with scrape type 2
2026-03-30 06:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4c27382-958e-5a57-a374-cc5bbf9bb107, identifier: XG78085
2026-03-30 06:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4c27382-958e-5a57-a374-cc5bbf9bb107 with identifier: XG78085
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 06:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 06:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4c27382-958e-5a57-a374-cc5bbf9bb107 with identifier: XG78085
2026-03-30 06:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4c27382-958e-5a57-a374-cc5bbf9bb107 with identifier: XG78085 to the API
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:57:38Z',
 'fuel_type': 'hybrid',
 'id': 'c4c27382-958e-5a57-a374-cc5bbf9bb107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG78085',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 146611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78085%27 HTTP/1.1" 200 None
2026-03-30 06:35:20 [auto1.be] INFO: Saving data for XG78085: {'auction_closing_time': 1774972658.0, 'created_time': 1773138062.840043, 'last_price_update_time': 1774852520.752168}
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG78085') HTTP/1.1" 204 0
2026-03-30 06:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:20 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX47829%27 HTTP/1.1" 200 None
2026-03-30 06:35:20 [auto1.be] INFO: Scrape type for VX47829: 2
2026-03-30 06:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d1f814-94aa-5f0b-8e80-26e43a0d81f6 with identifier: VX47829
2026-03-30 06:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d1f814-94aa-5f0b-8e80-26e43a0d81f6 with scrape type 2
2026-03-30 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22d1f814-94aa-5f0b-8e80-26e43a0d81f6 with scrape type 2
2026-03-30 06:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22d1f814-94aa-5f0b-8e80-26e43a0d81f6, identifier: VX47829
2026-03-30 06:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22d1f814-94aa-5f0b-8e80-26e43a0d81f6 with identifier: VX47829
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 06:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22d1f814-94aa-5f0b-8e80-26e43a0d81f6 with identifier: VX47829
2026-03-30 06:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22d1f814-94aa-5f0b-8e80-26e43a0d81f6 with identifier: VX47829 to the API
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:27:27Z',
 'fuel_type': 'petrol',
 'id': '22d1f814-94aa-5f0b-8e80-26e43a0d81f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX47829',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 95233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-30',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 e-THP Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2017}
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX47829%27 HTTP/1.1" 200 None
2026-03-30 06:35:21 [auto1.be] INFO: Saving data for VX47829: {'auction_closing_time': 1774970847.0, 'created_time': 1773137635.530111, 'last_price_update_time': 1774852521.335239}
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VX47829') HTTP/1.1" 204 0
2026-03-30 06:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM64227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:21 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 06:35:21 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69232%27 HTTP/1.1" 200 None
2026-03-30 06:35:21 [auto1.be] INFO: Scrape type for GK69232: 2
2026-03-30 06:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac2a842-be35-516c-a455-2adaa37ace49 with identifier: GK69232
2026-03-30 06:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac2a842-be35-516c-a455-2adaa37ace49 with scrape type 2
2026-03-30 06:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac2a842-be35-516c-a455-2adaa37ace49 with scrape type 2
2026-03-30 06:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ac2a842-be35-516c-a455-2adaa37ace49, identifier: GK69232
2026-03-30 06:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ac2a842-be35-516c-a455-2adaa37ace49 with identifier: GK69232
2026-03-30 06:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ac2a842-be35-516c-a455-2adaa37ace49 with identifier: GK69232
2026-03-30 06:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ac2a842-be35-516c-a455-2adaa37ace49 with identifier: GK69232 to the API
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:24:30Z',
 'fuel_type': 'petrol',
 'id': '2ac2a842-be35-516c-a455-2adaa37ace49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK69232',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 147154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69232%27 HTTP/1.1" 200 None
2026-03-30 06:35:21 [auto1.be] INFO: Saving data for GK69232: {'auction_closing_time': 1774970670.0, 'created_time': 1773661877.767934, 'last_price_update_time': 1774852521.786893}
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GK69232') HTTP/1.1" 204 0
2026-03-30 06:35:21 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ11174%27 HTTP/1.1" 200 None
2026-03-30 06:35:21 [auto1.be] INFO: Scrape type for FJ11174: 2
2026-03-30 06:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58787366-7190-5deb-9c40-9dcdecde32e1 with identifier: FJ11174
2026-03-30 06:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58787366-7190-5deb-9c40-9dcdecde32e1 with scrape type 2
2026-03-30 06:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58787366-7190-5deb-9c40-9dcdecde32e1 with scrape type 2
2026-03-30 06:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58787366-7190-5deb-9c40-9dcdecde32e1, identifier: FJ11174
2026-03-30 06:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58787366-7190-5deb-9c40-9dcdecde32e1 with identifier: FJ11174
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 06:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58787366-7190-5deb-9c40-9dcdecde32e1 with identifier: FJ11174
2026-03-30 06:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58787366-7190-5deb-9c40-9dcdecde32e1 with identifier: FJ11174 to the API
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:40:22Z',
 'fuel_type': 'petrol',
 'id': '58787366-7190-5deb-9c40-9dcdecde32e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ11174',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ11174%27 HTTP/1.1" 200 None
2026-03-30 06:35:22 [auto1.be] INFO: Saving data for FJ11174: {'auction_closing_time': 1774971622.0, 'created_time': 1774125441.719561, 'last_price_update_time': 1774852522.372091}
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ11174') HTTP/1.1" 204 0
2026-03-30 06:35:22 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 06:35:22 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-30 06:35:22 [auto1.be] INFO: Scrape type for SZ91004: 2
2026-03-30 06:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004
2026-03-30 06:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64aa4d5-64ce-5705-9663-f0b9793f1120 with scrape type 2
2026-03-30 06:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64aa4d5-64ce-5705-9663-f0b9793f1120 with scrape type 2
2026-03-30 06:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f64aa4d5-64ce-5705-9663-f0b9793f1120, identifier: SZ91004
2026-03-30 06:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004
2026-03-30 06:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004
2026-03-30 06:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004 to the API
2026-03-30 06:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:50:52Z',
 'fuel_type': 'hybrid',
 'id': 'f64aa4d5-64ce-5705-9663-f0b9793f1120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ91004',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 67655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-25',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Saving data for SZ91004: {'auction_closing_time': 1774972252.0, 'created_time': 1774039039.044946, 'last_price_update_time': 1774852523.238245}
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ91004') HTTP/1.1" 204 0
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH88253%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for CH88253: 2
2026-03-30 06:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6de7e374-43f8-510a-937e-a85988e4896d with identifier: CH88253
2026-03-30 06:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de7e374-43f8-510a-937e-a85988e4896d with scrape type 2
2026-03-30 06:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6de7e374-43f8-510a-937e-a85988e4896d with scrape type 2
2026-03-30 06:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6de7e374-43f8-510a-937e-a85988e4896d, identifier: CH88253
2026-03-30 06:35:23 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6de7e374-43f8-510a-937e-a85988e4896d with identifier: CH88253
2026-03-30 06:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6de7e374-43f8-510a-937e-a85988e4896d with identifier: CH88253
2026-03-30 06:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6de7e374-43f8-510a-937e-a85988e4896d with identifier: CH88253 to the API
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:39:01Z',
 'fuel_type': 'diesel',
 'id': '6de7e374-43f8-510a-937e-a85988e4896d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH88253',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 185116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-10',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2016}
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH88253%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Saving data for CH88253: {'auction_closing_time': 1774971541.0, 'created_time': 1774298265.716168, 'last_price_update_time': 1774852523.709575}
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH88253') HTTP/1.1" 204 0
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY37950%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for TY37950: 1
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: FG04950
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: SR54305
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR54305%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for SR54305: 0
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 06:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:23 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/HM64227/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD13812%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for KD13812: 2
2026-03-30 06:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08461fe7-5b01-5bfd-888b-c607dc2345d4 with identifier: KD13812
2026-03-30 06:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08461fe7-5b01-5bfd-888b-c607dc2345d4 with scrape type 2
2026-03-30 06:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08461fe7-5b01-5bfd-888b-c607dc2345d4 with scrape type 2
2026-03-30 06:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 08461fe7-5b01-5bfd-888b-c607dc2345d4, identifier: KD13812
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ73226%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for MJ73226: 0
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-30 06:35:23 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 06:35:23 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 06:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS35098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 08461fe7-5b01-5bfd-888b-c607dc2345d4 with identifier: KD13812
2026-03-30 06:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 08461fe7-5b01-5bfd-888b-c607dc2345d4 with identifier: KD13812
2026-03-30 06:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 08461fe7-5b01-5bfd-888b-c607dc2345d4 with identifier: KD13812 to the API
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:27:49Z',
 'fuel_type': 'diesel',
 'id': '08461fe7-5b01-5bfd-888b-c607dc2345d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD13812',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 178489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD13812%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Saving data for KD13812: {'auction_closing_time': 1774970869.0, 'created_time': 1774298296.24107, 'last_price_update_time': 1774852524.261432}
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD13812') HTTP/1.1" 204 0
2026-03-30 06:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN92129%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for WN92129: 2
2026-03-30 06:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61218926-72ba-5091-868c-97875ed9dc8b with identifier: WN92129
2026-03-30 06:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61218926-72ba-5091-868c-97875ed9dc8b with scrape type 2
2026-03-30 06:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61218926-72ba-5091-868c-97875ed9dc8b with scrape type 2
2026-03-30 06:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61218926-72ba-5091-868c-97875ed9dc8b, identifier: WN92129
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS14605%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for BS14605: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 06:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61218926-72ba-5091-868c-97875ed9dc8b with identifier: WN92129
2026-03-30 06:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61218926-72ba-5091-868c-97875ed9dc8b with identifier: WN92129
2026-03-30 06:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61218926-72ba-5091-868c-97875ed9dc8b with identifier: WN92129 to the API
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-31T15:42:10Z',
 'fuel_type': 'petrol',
 'id': '61218926-72ba-5091-868c-97875ed9dc8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN92129',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 94905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN92129%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Saving data for WN92129: {'auction_closing_time': 1774971730.0, 'created_time': 1773693859.837074, 'last_price_update_time': 1774852524.838119}
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN92129') HTTP/1.1" 204 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-30 06:35:24 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 06:35:24 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78085%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for XG78085: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX47829%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for VX47829: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69232%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for GK69232: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ11174%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for FJ11174: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH88253%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for CH88253: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 06:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN20180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD13812%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for KD13812: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN92129%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for WN92129: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-30 06:35:25 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 06:35:25 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 06:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:26 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for DT10357: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for SW43031: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for KH45960: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for AM39981: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for WP77155: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for CY85383: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for RX06086: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-30 06:35:26 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-30 06:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM64227> (referer: https://www.auto1.com/v1/car-details-view/HM64227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS35098> (referer: https://www.auto1.com/v1/car-details-view/GS35098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN20180> (referer: https://www.auto1.com/v1/car-details-view/JN20180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b7ae38-fbab-51d1-92d9-849a3bcf390e with identifier: HM64227
2026-03-30 06:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b7ae38-fbab-51d1-92d9-849a3bcf390e with scrape type 1
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78b7ae38-fbab-51d1-92d9-849a3bcf390e
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_9aa53ba23f7d668a75a0fb270ee38938.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_9aa53ba23f7d668a75a0fb270ee38938.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_303d9aced02a06117ae062d1c73f0897.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_303d9aced02a06117ae062d1c73f0897.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_041ddd928910bf81f9bc3a9291ceb4f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_041ddd928910bf81f9bc3a9291ceb4f0.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_4cc0cb0ca32720860ebd09a8e0dd9e2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_4cc0cb0ca32720860ebd09a8e0dd9e2b.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_3f9ebab4c6bfc364003188fe6d1d1c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3f9ebab4c6bfc364003188fe6d1d1c13.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_df79f56a058f171f9579b422b36f0453.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_df79f56a058f171f9579b422b36f0453.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_3b5881c2979ee740ea8a8c6d83b1234c.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3b5881c2979ee740ea8a8c6d83b1234c.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_40367fb36bd2c5b42e9b2ee4b6710556.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_40367fb36bd2c5b42e9b2ee4b6710556.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_3c089e850a4833aeb232dabfc216c793.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3c089e850a4833aeb232dabfc216c793.jpg already downloaded
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F9d%252F1e9de6a690819609387d09551460a6de%252Fpa%252FHM64227_9112a4e27c6768d1370af924506240bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_9112a4e27c6768d1370af924506240bf.jpg already downloaded
2026-03-30 06:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78b7ae38-fbab-51d1-92d9-849a3bcf390e, identifier: HM64227
2026-03-30 06:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 509a23fc-1d60-51f2-b422-3d7c063c6b7f with identifier: GS35098
2026-03-30 06:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f with scrape type 1
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_53264513eace5a1712d276686c684fa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_53264513eace5a1712d276686c684fa0.jpg not downloaded yet
2026-03-30 06:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e2aa22-eaab-5d30-858c-fb83f34780a8 with identifier: JN20180
2026-03-30 06:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e2aa22-eaab-5d30-858c-fb83f34780a8 with scrape type 1
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_8b1eb16fed65a6f968124be4c843cce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8b1eb16fed65a6f968124be4c843cce0.jpg not downloaded yet
2026-03-30 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78b7ae38-fbab-51d1-92d9-849a3bcf390e with identifier: HM64227
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78b7ae38-fbab-51d1-92d9-849a3bcf390e with identifier: HM64227
2026-03-30 06:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78b7ae38-fbab-51d1-92d9-849a3bcf390e with identifier: HM64227 to the API
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM64227>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:50:52Z',
 'fuel_type': 'petrol',
 'id': '78b7ae38-fbab-51d1-92d9-849a3bcf390e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM64227',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 74545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_9aa53ba23f7d668a75a0fb270ee38938.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_303d9aced02a06117ae062d1c73f0897.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_041ddd928910bf81f9bc3a9291ceb4f0.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_4cc0cb0ca32720860ebd09a8e0dd9e2b.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3f9ebab4c6bfc364003188fe6d1d1c13.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_df79f56a058f171f9579b422b36f0453.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3b5881c2979ee740ea8a8c6d83b1234c.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_40367fb36bd2c5b42e9b2ee4b6710556.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3c089e850a4833aeb232dabfc216c793.jpg',
                'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_9112a4e27c6768d1370af924506240bf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_9aa53ba23f7d668a75a0fb270ee38938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_303d9aced02a06117ae062d1c73f0897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_041ddd928910bf81f9bc3a9291ceb4f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_4cc0cb0ca32720860ebd09a8e0dd9e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3f9ebab4c6bfc364003188fe6d1d1c13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_df79f56a058f171f9579b422b36f0453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3b5881c2979ee740ea8a8c6d83b1234c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_40367fb36bd2c5b42e9b2ee4b6710556.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_3c089e850a4833aeb232dabfc216c793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78b7ae38-fbab-51d1-92d9-849a3bcf390e/78b7ae38-fbab-51d1-92d9-849a3bcf390e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/9d/1e9de6a690819609387d09551460a6de/pa/HM64227_9112a4e27c6768d1370af924506240bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2013}
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM64227%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [auto1.be] INFO: Saving data for HM64227: {'created_time': 1774852527.526171, 'last_price_update_time': 1774852527.526183, 'auction_closing_time': 1774972252.0}
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM64227') HTTP/1.1" 204 0
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_71345ada3cea44a0275c28d783910eac.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_71345ada3cea44a0275c28d783910eac.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_4de5241bedd598336bfa87c1e8f7ff8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_4de5241bedd598336bfa87c1e8f7ff8e.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_485be4537f8a3d02e044ef9657c02790.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_485be4537f8a3d02e044ef9657c02790.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_dbfded1300ffd49fc6c3eabcb05ce44f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_dbfded1300ffd49fc6c3eabcb05ce44f.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_3d9bef4626c9f9cf1c48463773a9c58f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_3d9bef4626c9f9cf1c48463773a9c58f.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_8e4978803421612d6d2c1ac8386d0e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8e4978803421612d6d2c1ac8386d0e35.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_c8fa162a8fb7653d90eff1c979d4673e.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_c8fa162a8fb7653d90eff1c979d4673e.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_043cefa0dd9e646fc919492809fb61cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_043cefa0dd9e646fc919492809fb61cb.jpg not downloaded yet
2026-03-30 06:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY37950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_2245aa42a043648b499d36d5e765fbe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_2245aa42a043648b499d36d5e765fbe4.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_90ccbf30cdf6d789bc0f2f52a75c730f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_90ccbf30cdf6d789bc0f2f52a75c730f.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_d7aef6be872f8397d41e14dcce37c208.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_d7aef6be872f8397d41e14dcce37c208.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_207562d923666d86ae95df3a6d513da5.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_207562d923666d86ae95df3a6d513da5.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_6db2b3646ad3c0e1e99b0fe3b5c8706b.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_6db2b3646ad3c0e1e99b0fe3b5c8706b.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_d7c7130862f1bd26e2a7703f5e33039a.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_d7c7130862f1bd26e2a7703f5e33039a.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_72dca40912df39dc528e7deddca5b582.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_72dca40912df39dc528e7deddca5b582.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_803073811e07d893ac86c1dfd6e63572.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_803073811e07d893ac86c1dfd6e63572.jpg not downloaded yet
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_116aa6c4e97e29edbb9b506f7bedfa32.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_116aa6c4e97e29edbb9b506f7bedfa32.jpg not downloaded yet
2026-03-30 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_cc6a3e659e86dc8f6e59527dedb30ee2.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_cc6a3e659e86dc8f6e59527dedb30ee2.jpg not downloaded yet
2026-03-30 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_53264513eace5a1712d276686c684fa0.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8b1eb16fed65a6f968124be4c843cce0.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_dbfded1300ffd49fc6c3eabcb05ce44f.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_4de5241bedd598336bfa87c1e8f7ff8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_90ccbf30cdf6d789bc0f2f52a75c730f.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 06:35:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 06:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc3ee9d0>
2026-03-30 06:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:35:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-30 06:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_53264513eace5a1712d276686c684fa0.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_53264513eace5a1712d276686c684fa0.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_3d9bef4626c9f9cf1c48463773a9c58f.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8e4978803421612d6d2c1ac8386d0e35.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_207562d923666d86ae95df3a6d513da5.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_71345ada3cea44a0275c28d783910eac.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_043cefa0dd9e646fc919492809fb61cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_c8fa162a8fb7653d90eff1c979d4673e.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_2245aa42a043648b499d36d5e765fbe4.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_485be4537f8a3d02e044ef9657c02790.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc40af50>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_8b1eb16fed65a6f968124be4c843cce0.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8b1eb16fed65a6f968124be4c843cce0.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc30abd0>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_dbfded1300ffd49fc6c3eabcb05ce44f.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_dbfded1300ffd49fc6c3eabcb05ce44f.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc311550>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_4de5241bedd598336bfa87c1e8f7ff8e.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_4de5241bedd598336bfa87c1e8f7ff8e.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc30f4d0>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_90ccbf30cdf6d789bc0f2f52a75c730f.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_90ccbf30cdf6d789bc0f2f52a75c730f.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_72dca40912df39dc528e7deddca5b582.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_cc6a3e659e86dc8f6e59527dedb30ee2.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_116aa6c4e97e29edbb9b506f7bedfa32.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_d7c7130862f1bd26e2a7703f5e33039a.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc31ce90>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_3d9bef4626c9f9cf1c48463773a9c58f.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_3d9bef4626c9f9cf1c48463773a9c58f.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc043d90>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_8e4978803421612d6d2c1ac8386d0e35.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8e4978803421612d6d2c1ac8386d0e35.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc059b50>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_207562d923666d86ae95df3a6d513da5.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_207562d923666d86ae95df3a6d513da5.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc04a810>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_71345ada3cea44a0275c28d783910eac.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_71345ada3cea44a0275c28d783910eac.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc31c8d0>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_043cefa0dd9e646fc919492809fb61cb.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_043cefa0dd9e646fc919492809fb61cb.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc061310>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_c8fa162a8fb7653d90eff1c979d4673e.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_c8fa162a8fb7653d90eff1c979d4673e.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc058690>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_2245aa42a043648b499d36d5e765fbe4.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_2245aa42a043648b499d36d5e765fbe4.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc04bc50>
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_485be4537f8a3d02e044ef9657c02790.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_485be4537f8a3d02e044ef9657c02790.jpg saved to cache
2026-03-30 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:29 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_803073811e07d893ac86c1dfd6e63572.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_6db2b3646ad3c0e1e99b0fe3b5c8706b.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_d7aef6be872f8397d41e14dcce37c208.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-30 06:35:29 [auto1.be] INFO: Scrape type for KT58942: 0
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-30 06:35:29 [auto1.be] INFO: Scrape type for UY87343: 0
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-30 06:35:29 [auto1.be] INFO: Scrape type for MH83966: 0
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-30 06:35:29 [auto1.be] INFO: Scrape type for AD76625: 0
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-30 06:35:29 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for HX23250: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for DH89229: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for UZ99297: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for DZ79289: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for ZY04103: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for EP64027: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for SD10160: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for PZ32696: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for YA34487: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for RC41327: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for BL31735: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for PJ34917: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for TM16461: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for KD33371: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for ZM02853: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for ZP04877: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for BY53413: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for LY35485: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-30 06:35:30 [auto1.be] INFO: Scrape type for KU68109: 0
2026-03-30 06:35:30 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-30 06:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc061710>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_72dca40912df39dc528e7deddca5b582.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_72dca40912df39dc528e7deddca5b582.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc347610>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_cc6a3e659e86dc8f6e59527dedb30ee2.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_cc6a3e659e86dc8f6e59527dedb30ee2.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc3ce790>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_116aa6c4e97e29edbb9b506f7bedfa32.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_116aa6c4e97e29edbb9b506f7bedfa32.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc3bf750>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_d7c7130862f1bd26e2a7703f5e33039a.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_d7c7130862f1bd26e2a7703f5e33039a.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9cc2e7c10>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8c20ad32ed721a77a262eecd2a7631%252Fpa%252FJN20180_803073811e07d893ac86c1dfd6e63572.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_803073811e07d893ac86c1dfd6e63572.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43e2aa22-eaab-5d30-858c-fb83f34780a8
2026-03-30 06:35:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43e2aa22-eaab-5d30-858c-fb83f34780a8, skipping ID generation
2026-03-30 06:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e2aa22-eaab-5d30-858c-fb83f34780a8 with scrape type 1
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43e2aa22-eaab-5d30-858c-fb83f34780a8 sending to next pipeline
2026-03-30 06:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43e2aa22-eaab-5d30-858c-fb83f34780a8, identifier: JN20180
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9ce637950>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_6db2b3646ad3c0e1e99b0fe3b5c8706b.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_6db2b3646ad3c0e1e99b0fe3b5c8706b.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb9ce556650>
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F6e%252F526ede47adf029aafff9be3f579ed93b%252Fpa%252FGS35098_d7aef6be872f8397d41e14dcce37c208.jpg') HTTP/1.1" 204 0
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_d7aef6be872f8397d41e14dcce37c208.jpg saved to cache
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f
2026-03-30 06:35:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 509a23fc-1d60-51f2-b422-3d7c063c6b7f, skipping ID generation
2026-03-30 06:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f with scrape type 1
2026-03-30 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 509a23fc-1d60-51f2-b422-3d7c063c6b7f sending to next pipeline
2026-03-30 06:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 509a23fc-1d60-51f2-b422-3d7c063c6b7f, identifier: GS35098
2026-03-30 06:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43e2aa22-eaab-5d30-858c-fb83f34780a8 with identifier: JN20180
2026-03-30 06:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43e2aa22-eaab-5d30-858c-fb83f34780a8 with identifier: JN20180
2026-03-30 06:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43e2aa22-eaab-5d30-858c-fb83f34780a8 with identifier: JN20180 to the API
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_803073811e07d893ac86c1dfd6e63572.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:26:39Z',
 'fuel_type': 'diesel',
 'id': '43e2aa22-eaab-5d30-858c-fb83f34780a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN20180',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 137575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8b1eb16fed65a6f968124be4c843cce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_4de5241bedd598336bfa87c1e8f7ff8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_dbfded1300ffd49fc6c3eabcb05ce44f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_8e4978803421612d6d2c1ac8386d0e35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_043cefa0dd9e646fc919492809fb61cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_90ccbf30cdf6d789bc0f2f52a75c730f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_207562d923666d86ae95df3a6d513da5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_d7c7130862f1bd26e2a7703f5e33039a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_803073811e07d893ac86c1dfd6e63572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e2aa22-eaab-5d30-858c-fb83f34780a8/43e2aa22-eaab-5d30-858c-fb83f34780a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8c20ad32ed721a77a262eecd2a7631/pa/JN20180_cc6a3e659e86dc8f6e59527dedb30ee2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN20180%27 HTTP/1.1" 200 None
2026-03-30 06:35:31 [auto1.be] INFO: Saving data for JN20180: {'created_time': 1774852531.682723, 'last_price_update_time': 1774852531.682734, 'auction_closing_time': 1774970799.0}
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JN20180') HTTP/1.1" 204 0
2026-03-30 06:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 509a23fc-1d60-51f2-b422-3d7c063c6b7f with identifier: GS35098
2026-03-30 06:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 509a23fc-1d60-51f2-b422-3d7c063c6b7f with identifier: GS35098
2026-03-30 06:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 509a23fc-1d60-51f2-b422-3d7c063c6b7f with identifier: GS35098 to the API
2026-03-30 06:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_d7aef6be872f8397d41e14dcce37c208.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:43:22Z',
 'fuel_type': 'diesel',
 'id': '509a23fc-1d60-51f2-b422-3d7c063c6b7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS35098',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 66466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_53264513eace5a1712d276686c684fa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_71345ada3cea44a0275c28d783910eac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_485be4537f8a3d02e044ef9657c02790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_3d9bef4626c9f9cf1c48463773a9c58f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_c8fa162a8fb7653d90eff1c979d4673e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_2245aa42a043648b499d36d5e765fbe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_d7aef6be872f8397d41e14dcce37c208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_6db2b3646ad3c0e1e99b0fe3b5c8706b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_72dca40912df39dc528e7deddca5b582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509a23fc-1d60-51f2-b422-3d7c063c6b7f/509a23fc-1d60-51f2-b422-3d7c063c6b7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/6e/526ede47adf029aafff9be3f579ed93b/pa/GS35098_116aa6c4e97e29edbb9b506f7bedfa32.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Talento 1.6 Turbodiesel Ecojet L1H1 1,0t Basis',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t Basis',
 'year': 2020}
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS35098%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [auto1.be] INFO: Saving data for GS35098: {'created_time': 1774852532.132573, 'last_price_update_time': 1774852532.132589, 'auction_closing_time': 1774971802.0}
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS35098') HTTP/1.1" 204 0
2026-03-30 06:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY37950> (referer: https://www.auto1.com/v1/car-details-view/TY37950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f8c286a-c5c7-553c-b96b-2f7d31094882 with identifier: TY37950
2026-03-30 06:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f8c286a-c5c7-553c-b96b-2f7d31094882 with scrape type 1
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f8c286a-c5c7-553c-b96b-2f7d31094882
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_98e65c7f8f11bc07e61f8670b4c0df67.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_98e65c7f8f11bc07e61f8670b4c0df67.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_9269c7fe773520569d0a098e67f8b5a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_9269c7fe773520569d0a098e67f8b5a4.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_597b2f2f5aa28d083ff90a6745515506.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_597b2f2f5aa28d083ff90a6745515506.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_91ef6e72ff77ae270fdcac4562debacb.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_91ef6e72ff77ae270fdcac4562debacb.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_e2ec4365e5d51a9eb8c47b7534ce3ae6.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_e2ec4365e5d51a9eb8c47b7534ce3ae6.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_947897ebcc9d9d1e191768106c0bea98.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_947897ebcc9d9d1e191768106c0bea98.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_8c8182140f30de01588a319909efac12.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_8c8182140f30de01588a319909efac12.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_ab55f84264b5489d5e0c9382d8f9a052.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_ab55f84264b5489d5e0c9382d8f9a052.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_4b0f5845b72050557383befd8291d400.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_4b0f5845b72050557383befd8291d400.jpg already downloaded
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e615e836798528ce749797ef3652d9%252Fpa%252FTY37950_c92b95cfa6783c1dd40d42fb562af8c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_c92b95cfa6783c1dd40d42fb562af8c9.jpg already downloaded
2026-03-30 06:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f8c286a-c5c7-553c-b96b-2f7d31094882, identifier: TY37950
2026-03-30 06:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f8c286a-c5c7-553c-b96b-2f7d31094882 with identifier: TY37950
2026-03-30 06:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f8c286a-c5c7-553c-b96b-2f7d31094882 with identifier: TY37950
2026-03-30 06:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f8c286a-c5c7-553c-b96b-2f7d31094882 with identifier: TY37950 to the API
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY37950>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:49:32Z',
 'fuel_type': 'petrol',
 'id': '1f8c286a-c5c7-553c-b96b-2f7d31094882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY37950',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 27322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_98e65c7f8f11bc07e61f8670b4c0df67.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_9269c7fe773520569d0a098e67f8b5a4.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_597b2f2f5aa28d083ff90a6745515506.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_91ef6e72ff77ae270fdcac4562debacb.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_e2ec4365e5d51a9eb8c47b7534ce3ae6.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_947897ebcc9d9d1e191768106c0bea98.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_8c8182140f30de01588a319909efac12.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_ab55f84264b5489d5e0c9382d8f9a052.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_4b0f5845b72050557383befd8291d400.jpg',
                'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_c92b95cfa6783c1dd40d42fb562af8c9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_98e65c7f8f11bc07e61f8670b4c0df67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_9269c7fe773520569d0a098e67f8b5a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_597b2f2f5aa28d083ff90a6745515506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_91ef6e72ff77ae270fdcac4562debacb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_e2ec4365e5d51a9eb8c47b7534ce3ae6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_947897ebcc9d9d1e191768106c0bea98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_8c8182140f30de01588a319909efac12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_ab55f84264b5489d5e0c9382d8f9a052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_4b0f5845b72050557383befd8291d400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f8c286a-c5c7-553c-b96b-2f7d31094882/1f8c286a-c5c7-553c-b96b-2f7d31094882_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e615e836798528ce749797ef3652d9/pa/TY37950_c92b95cfa6783c1dd40d42fb562af8c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.0 VTi Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2016}
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY37950%27 HTTP/1.1" 200 None
2026-03-30 06:35:32 [auto1.be] INFO: Saving data for TY37950: {'created_time': 1774852532.888419, 'last_price_update_time': 1774852532.88843, 'auction_closing_time': 1774972172.0}
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY37950') HTTP/1.1" 204 0
2026-03-30 06:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for VL25326: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for XY08671: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for BY20726: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for KF56069: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for BV02466: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for SY52065: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for NG60197: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for YR77899: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-30 06:35:33 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-30 06:35:33 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for UA36767: 0
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for WA86347: 0
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for PS31946: 0
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for ZP25114: 0
2026-03-30 06:35:34 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-30 06:35:34 [auto1.be] INFO: Scrape type for FP22064: 0
2026-03-30 06:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:35 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for LU53556: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for TT03576: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for CM14446: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for VE29498: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for AM49333: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for FC05247: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for NC38410: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for TX69988: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for HK94342: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for SL05027: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for EK47235: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for SJ26894: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for VP06293: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for DH17925: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for UX80051: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for MG99487: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for FG10633: 0
2026-03-30 06:35:35 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-30 06:35:35 [auto1.be] INFO: Scrape type for KE27400: 0
2026-03-30 06:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:36 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:36 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-30 06:35:36 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-30 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-30 06:35:36 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-30 06:35:36 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-30 06:35:36 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-30 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-30 06:35:36 [auto1.be] INFO: Scrape type for ZU13483: 2
2026-03-30 06:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-30 06:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with scrape type 2
2026-03-30 06:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with scrape type 2
2026-03-30 06:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981, identifier: ZU13483
2026-03-30 06:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-30 06:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-30 06:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483 to the API
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'diesel',
 'id': '22e8a7fe-0993-5ecf-a4c0-096bbedfa981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU13483',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 209620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-02',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Saving data for ZU13483: {'auction_closing_time': 1774885120.0, 'created_time': 1774643810.612907, 'last_price_update_time': 1774852537.361464}
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU13483') HTTP/1.1" 204 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-30 06:35:37 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-30 06:35:37 [auto1.be] INFO: Scrape type for CC85070: 2
2026-03-30 06:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-30 06:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d62c776-1845-5548-aec3-c1ce832c593e with scrape type 2
2026-03-30 06:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d62c776-1845-5548-aec3-c1ce832c593e with scrape type 2
2026-03-30 06:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d62c776-1845-5548-aec3-c1ce832c593e, identifier: CC85070
2026-03-30 06:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-30 06:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-30 06:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070 to the API
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:19:50Z',
 'fuel_type': 'diesel',
 'id': '5d62c776-1845-5548-aec3-c1ce832c593e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC85070',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 146976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Kia Rio 1.4 CRDi Platinum Edition',
 'transmission': 'manual',
 'trim': 'Platinum Edition',
 'year': 2017}
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-30 06:35:38 [auto1.be] INFO: Saving data for CC85070: {'auction_closing_time': 1774883990.0, 'created_time': 1774643898.572376, 'last_price_update_time': 1774852538.052933}
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC85070') HTTP/1.1" 204 0
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-30 06:35:38 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-30 06:35:38 [auto1.be] INFO: Scrape type for SR49598: 2
2026-03-30 06:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-30 06:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497af0eb-e19b-5f91-ad5a-aa140478438e with scrape type 2
2026-03-30 06:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497af0eb-e19b-5f91-ad5a-aa140478438e with scrape type 2
2026-03-30 06:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 497af0eb-e19b-5f91-ad5a-aa140478438e, identifier: SR49598
2026-03-30 06:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-30 06:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-30 06:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598 to the API
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'diesel',
 'id': '497af0eb-e19b-5f91-ad5a-aa140478438e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR49598',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 165232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-30 06:35:38 [auto1.be] INFO: Saving data for SR49598: {'auction_closing_time': 1774885534.0, 'created_time': 1773909326.499568, 'last_price_update_time': 1774852538.545387}
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR49598') HTTP/1.1" 204 0
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-30 06:35:38 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-30 06:35:38 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-30 06:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:39 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-30 06:35:39 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-30 06:35:39 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 06:35:39 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-30 06:35:39 [auto1.be] INFO: Scrape type for XZ48466: 2
2026-03-30 06:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-30 06:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d284c50-6d79-5bb3-af67-aed85c560e66 with scrape type 2
2026-03-30 06:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d284c50-6d79-5bb3-af67-aed85c560e66 with scrape type 2
2026-03-30 06:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d284c50-6d79-5bb3-af67-aed85c560e66, identifier: XZ48466
2026-03-30 06:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-30 06:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-30 06:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466 to the API
2026-03-30 06:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:09:58Z',
 'fuel_type': 'petrol',
 'id': '8d284c50-6d79-5bb3-af67-aed85c560e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ48466',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 151715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2009}
2026-03-30 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-30 06:35:40 [auto1.be] INFO: Saving data for XZ48466: {'auction_closing_time': 1774883398.0, 'created_time': 1774643970.568567, 'last_price_update_time': 1774852540.887907}
2026-03-30 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ48466') HTTP/1.1" 204 0
2026-03-30 06:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for WE70666: 2
2026-03-30 06:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-30 06:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed47b16-c131-53a7-a3d0-b7cd0c941363 with scrape type 2
2026-03-30 06:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eed47b16-c131-53a7-a3d0-b7cd0c941363 with scrape type 2
2026-03-30 06:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eed47b16-c131-53a7-a3d0-b7cd0c941363, identifier: WE70666
2026-03-30 06:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-30 06:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-30 06:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666 to the API
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:14:10Z',
 'fuel_type': 'petrol',
 'id': 'eed47b16-c131-53a7-a3d0-b7cd0c941363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE70666',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 71558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Saving data for WE70666: {'auction_closing_time': 1774883650.0, 'created_time': 1773747359.176413, 'last_price_update_time': 1774852541.436825}
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE70666') HTTP/1.1" 204 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-30 06:35:41 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-30 06:35:41 [auto1.be] INFO: Scrape type for SD77902: 2
2026-03-30 06:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-30 06:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3858bf66-719b-5ee3-a92c-0e3d097032db with scrape type 2
2026-03-30 06:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3858bf66-719b-5ee3-a92c-0e3d097032db with scrape type 2
2026-03-30 06:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3858bf66-719b-5ee3-a92c-0e3d097032db, identifier: SD77902
2026-03-30 06:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-30 06:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-30 06:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902 to the API
2026-03-30 06:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:03:49Z',
 'fuel_type': 'diesel',
 'id': '3858bf66-719b-5ee3-a92c-0e3d097032db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD77902',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 220247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel',
 'transmission': 'manual',
 'trim': 'Travel',
 'year': 2010}
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-30 06:35:42 [auto1.be] INFO: Saving data for SD77902: {'auction_closing_time': 1774883029.0, 'created_time': 1774644017.628546, 'last_price_update_time': 1774852542.436144}
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD77902') HTTP/1.1" 204 0
2026-03-30 06:35:42 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-30 06:35:42 [auto1.be] INFO: Scrape type for EK72945: 2
2026-03-30 06:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-30 06:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ed6b60-6709-5554-b716-4d6806724a89 with scrape type 2
2026-03-30 06:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ed6b60-6709-5554-b716-4d6806724a89 with scrape type 2
2026-03-30 06:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d5ed6b60-6709-5554-b716-4d6806724a89, identifier: EK72945
2026-03-30 06:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-30 06:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-30 06:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945 to the API
2026-03-30 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:56:41Z',
 'fuel_type': 'petrol',
 'id': 'd5ed6b60-6709-5554-b716-4d6806724a89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK72945',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 157243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-09',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2014}
2026-03-30 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-30 06:35:43 [auto1.be] INFO: Saving data for EK72945: {'auction_closing_time': 1774886201.0, 'created_time': 1773134803.074061, 'last_price_update_time': 1774852543.404478}
2026-03-30 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK72945') HTTP/1.1" 204 0
2026-03-30 06:35:43 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-30 06:35:43 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-30 06:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:44 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for WJ85942: 2
2026-03-30 06:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-30 06:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 with scrape type 2
2026-03-30 06:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 with scrape type 2
2026-03-30 06:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a29a99ba-c57d-5253-ae98-692c57ecd3b3, identifier: WJ85942
2026-03-30 06:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-30 06:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-30 06:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942 to the API
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:12:57Z',
 'fuel_type': 'diesel',
 'id': 'a29a99ba-c57d-5253-ae98-692c57ecd3b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ85942',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 82952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L1 Premium',
 'transmission': 'manual',
 'trim': 'L1 Premium',
 'year': 2018}
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Saving data for WJ85942: {'auction_closing_time': 1774883577.0, 'created_time': 1774643960.031396, 'last_price_update_time': 1774852544.495581}
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ85942') HTTP/1.1" 204 0
2026-03-30 06:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for ZL62218: 0
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-30 06:35:44 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-30 06:35:44 [auto1.be] INFO: Scrape type for JB70681: 2
2026-03-30 06:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-30 06:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with scrape type 2
2026-03-30 06:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with scrape type 2
2026-03-30 06:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8, identifier: JB70681
2026-03-30 06:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-30 06:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-30 06:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681 to the API
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'petrol',
 'id': 'ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB70681',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 121416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-02',
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Saving data for JB70681: {'auction_closing_time': 1774883697.0, 'created_time': 1774643915.864878, 'last_price_update_time': 1774852545.005838}
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB70681') HTTP/1.1" 204 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for JS91755: 2
2026-03-30 06:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-30 06:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with scrape type 2
2026-03-30 06:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with scrape type 2
2026-03-30 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc, identifier: JS91755
2026-03-30 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-30 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-30 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755 to the API
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:07Z',
 'fuel_type': 'diesel',
 'id': '4c6c3904-b97d-5ba7-a81b-20e6b5724bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS91755',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 243744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2014}
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Saving data for JS91755: {'auction_closing_time': 1774883647.0, 'created_time': 1773240662.024707, 'last_price_update_time': 1774852545.496021}
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS91755') HTTP/1.1" 204 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-30 06:35:45 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-30 06:35:45 [auto1.be] INFO: Scrape type for NV81106: 2
2026-03-30 06:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-30 06:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3732b551-8397-54e7-ac71-594bf19ce099 with scrape type 2
2026-03-30 06:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3732b551-8397-54e7-ac71-594bf19ce099 with scrape type 2
2026-03-30 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3732b551-8397-54e7-ac71-594bf19ce099, identifier: NV81106
2026-03-30 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-30 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-30 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106 to the API
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': '3732b551-8397-54e7-ac71-594bf19ce099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV81106',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-30 06:35:46 [auto1.be] INFO: Saving data for NV81106: {'auction_closing_time': 1774884777.0, 'created_time': 1773224675.537605, 'last_price_update_time': 1774852546.039003}
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV81106') HTTP/1.1" 204 0
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-30 06:35:46 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-30 06:35:46 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-30 06:35:46 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-30 06:35:46 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-30 06:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:47 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-30 06:35:47 [auto1.be] INFO: Scrape type for AA49507: 2
2026-03-30 06:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-30 06:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 with scrape type 2
2026-03-30 06:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 with scrape type 2
2026-03-30 06:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 113c6d87-a1cf-5b58-b394-de32dd3d7393, identifier: AA49507
2026-03-30 06:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-30 06:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-30 06:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507 to the API
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:07Z',
 'fuel_type': 'petrol',
 'id': '113c6d87-a1cf-5b58-b394-de32dd3d7393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA49507',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 169803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2008}
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-30 06:35:47 [auto1.be] INFO: Saving data for AA49507: {'auction_closing_time': 1774884127.0, 'created_time': 1774643810.103388, 'last_price_update_time': 1774852547.538278}
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AA49507') HTTP/1.1" 204 0
2026-03-30 06:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-30 06:35:47 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-30 06:35:47 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-30 06:35:47 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-30 06:35:47 [auto1.be] INFO: Scrape type for BA52354: 2
2026-03-30 06:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-30 06:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with scrape type 2
2026-03-30 06:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with scrape type 2
2026-03-30 06:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f, identifier: BA52354
2026-03-30 06:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-30 06:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-30 06:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354 to the API
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:29Z',
 'fuel_type': 'petrol',
 'id': '6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA52354',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 252394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-10',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-30 06:35:48 [auto1.be] INFO: Saving data for BA52354: {'auction_closing_time': 1774883489.0, 'created_time': 1773434498.091555, 'last_price_update_time': 1774852548.060914}
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA52354') HTTP/1.1" 204 0
2026-03-30 06:35:48 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-30 06:35:48 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-30 06:35:48 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-30 06:35:48 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-30 06:35:48 [auto1.be] INFO: Scrape type for UC23117: 2
2026-03-30 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-30 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69a1ffc-e570-5729-b9e0-495f719664ad with scrape type 2
2026-03-30 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69a1ffc-e570-5729-b9e0-495f719664ad with scrape type 2
2026-03-30 06:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c69a1ffc-e570-5729-b9e0-495f719664ad, identifier: UC23117
2026-03-30 06:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-30 06:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-30 06:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117 to the API
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-30T15:33:37Z',
 'fuel_type': 'petrol',
 'id': 'c69a1ffc-e570-5729-b9e0-495f719664ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC23117',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 48513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-30 06:35:48 [auto1.be] INFO: Saving data for UC23117: {'auction_closing_time': 1774884817.0, 'created_time': 1774557330.897999, 'last_price_update_time': 1774852548.55021}
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC23117') HTTP/1.1" 204 0
2026-03-30 06:35:48 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-30 06:35:48 [auto1.be] INFO: Scrape type for RS46918: 2
2026-03-30 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-30 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with scrape type 2
2026-03-30 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with scrape type 2
2026-03-30 06:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1, identifier: RS46918
2026-03-30 06:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-30 06:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-30 06:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918 to the API
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'petrol',
 'id': '071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS46918',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 31878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-30 06:35:48 [auto1.be] INFO: Saving data for RS46918: {'auction_closing_time': 1774884968.0, 'created_time': 1774644003.566721, 'last_price_update_time': 1774852548.933467}
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS46918') HTTP/1.1" 204 0
2026-03-30 06:35:48 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-30 06:35:48 [auto1.be] INFO: Scrape type for GF24104: 2
2026-03-30 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-30 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92561579-2897-5a8e-bbd2-8a9c08ff274a with scrape type 2
2026-03-30 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92561579-2897-5a8e-bbd2-8a9c08ff274a with scrape type 2
2026-03-30 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92561579-2897-5a8e-bbd2-8a9c08ff274a, identifier: GF24104
2026-03-30 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-30 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-30 06:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104 to the API
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:32Z',
 'fuel_type': 'diesel',
 'id': '92561579-2897-5a8e-bbd2-8a9c08ff274a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF24104',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 186938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Saving data for GF24104: {'auction_closing_time': 1774883132.0, 'created_time': 1774643987.368553, 'last_price_update_time': 1774852549.30511}
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF24104') HTTP/1.1" 204 0
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Scrape type for PJ82537: 2
2026-03-30 06:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-30 06:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45fcdd64-6b7c-50e9-934f-6137291a16a3 with scrape type 2
2026-03-30 06:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45fcdd64-6b7c-50e9-934f-6137291a16a3 with scrape type 2
2026-03-30 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45fcdd64-6b7c-50e9-934f-6137291a16a3, identifier: PJ82537
2026-03-30 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-30 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-30 06:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537 to the API
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'petrol',
 'id': '45fcdd64-6b7c-50e9-934f-6137291a16a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ82537',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 23545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-20',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Saving data for PJ82537: {'auction_closing_time': 1774885715.0, 'created_time': 1774643916.637018, 'last_price_update_time': 1774852549.697069}
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ82537') HTTP/1.1" 204 0
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-30 06:35:49 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-30 06:35:49 [auto1.be] INFO: Scrape type for YP74524: 2
2026-03-30 06:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-30 06:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with scrape type 2
2026-03-30 06:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with scrape type 2
2026-03-30 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb, identifier: YP74524
2026-03-30 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-30 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-30 06:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524 to the API
2026-03-30 06:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'hybrid',
 'id': '87de171a-a0af-5ac6-8ec6-06d1f91ec5bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP74524',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 101969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-20',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-30 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-30 06:35:50 [auto1.be] INFO: Saving data for YP74524: {'auction_closing_time': 1774882837.0, 'created_time': 1774643921.33578, 'last_price_update_time': 1774852550.184045}
2026-03-30 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YP74524') HTTP/1.1" 204 0
2026-03-30 06:35:50 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-30 06:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:51 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:51 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-30 06:35:51 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-30 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-30 06:35:51 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-30 06:35:51 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-30 06:35:51 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-30 06:35:51 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-30 06:35:51 [auto1.be] INFO: Scrape type for LK55982: 2
2026-03-30 06:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-30 06:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184efd05-1fb9-5849-b280-511811641ad9 with scrape type 2
2026-03-30 06:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184efd05-1fb9-5849-b280-511811641ad9 with scrape type 2
2026-03-30 06:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 184efd05-1fb9-5849-b280-511811641ad9, identifier: LK55982
2026-03-30 06:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-30 06:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-30 06:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982 to the API
2026-03-30 06:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:17Z',
 'fuel_type': 'diesel',
 'id': '184efd05-1fb9-5849-b280-511811641ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK55982',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 138400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-05',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 30 L1H1 Business',
 'transmission': 'manual',
 'trim': '30 L1H1 Business',
 'year': 2018}
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-30 06:35:52 [auto1.be] INFO: Saving data for LK55982: {'auction_closing_time': 1774884137.0, 'created_time': 1774557326.626571, 'last_price_update_time': 1774852552.049605}
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK55982') HTTP/1.1" 204 0
2026-03-30 06:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:52 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-30 06:35:52 [auto1.be] INFO: Scrape type for DW77345: 2
2026-03-30 06:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-30 06:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66551045-57ae-5a77-b829-e167b3a9ebfb with scrape type 2
2026-03-30 06:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66551045-57ae-5a77-b829-e167b3a9ebfb with scrape type 2
2026-03-30 06:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66551045-57ae-5a77-b829-e167b3a9ebfb, identifier: DW77345
2026-03-30 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-30 06:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345 to the API
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:51:34Z',
 'fuel_type': 'diesel',
 'id': '66551045-57ae-5a77-b829-e167b3a9ebfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77345',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Terrano',
 'odometer': 133405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-28',
 'seller_name': None,
 'title': 'Nissan Terrano 3.0 TD Outdoor',
 'transmission': 'automatic',
 'trim': 'Outdoor',
 'year': 2006}
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-30 06:35:52 [auto1.be] INFO: Saving data for DW77345: {'auction_closing_time': 1774885894.0, 'created_time': 1774643745.435627, 'last_price_update_time': 1774852552.553221}
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW77345') HTTP/1.1" 204 0
2026-03-30 06:35:52 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-30 06:35:52 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-30 06:35:52 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-30 06:35:52 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-30 06:35:52 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-30 06:35:52 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-30 06:35:52 [auto1.be] INFO: Scrape type for AY47657: 2
2026-03-30 06:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-30 06:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with scrape type 2
2026-03-30 06:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with scrape type 2
2026-03-30 06:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb, identifier: AY47657
2026-03-30 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-30 06:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-30 06:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657 to the API
2026-03-30 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'petrol',
 'id': 'c5c2b53d-f5e2-5f18-8ab6-cff861f912fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY47657',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 94952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-30 06:35:53 [auto1.be] INFO: Saving data for AY47657: {'auction_closing_time': 1774886135.0, 'created_time': 1773434531.165153, 'last_price_update_time': 1774852553.389265}
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY47657') HTTP/1.1" 204 0
2026-03-30 06:35:53 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-30 06:35:53 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-30 06:35:53 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-30 06:35:53 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-30 06:35:53 [auto1.be] INFO: Scrape type for AE13452: 2
2026-03-30 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-30 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310dcb03-133e-514f-86fb-8ea9a6203674 with scrape type 2
2026-03-30 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310dcb03-133e-514f-86fb-8ea9a6203674 with scrape type 2
2026-03-30 06:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 310dcb03-133e-514f-86fb-8ea9a6203674, identifier: AE13452
2026-03-30 06:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-30 06:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-30 06:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452 to the API
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:55Z',
 'fuel_type': 'petrol',
 'id': '310dcb03-133e-514f-86fb-8ea9a6203674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE13452',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 69362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-30 06:35:53 [auto1.be] INFO: Saving data for AE13452: {'auction_closing_time': 1774885375.0, 'created_time': 1773239795.139885, 'last_price_update_time': 1774852553.877819}
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE13452') HTTP/1.1" 204 0
2026-03-30 06:35:53 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-30 06:35:53 [auto1.be] INFO: Scrape type for FG26500: 2
2026-03-30 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-30 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with scrape type 2
2026-03-30 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with scrape type 2
2026-03-30 06:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c, identifier: FG26500
2026-03-30 06:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-30 06:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-30 06:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500 to the API
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:18Z',
 'fuel_type': 'petrol',
 'id': 'd03f3a5b-3a25-51c7-8dfc-224a0197bd7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG26500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 103179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-13',
 'seller_name': None,
 'title': 'Opel Insignia 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Saving data for FG26500: {'auction_closing_time': 1774885818.0, 'created_time': 1773834457.531177, 'last_price_update_time': 1774852554.309758}
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG26500') HTTP/1.1" 204 0
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Scrape type for CK49467: 2
2026-03-30 06:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-30 06:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc0a755-e8d6-565a-ae23-49098886fea8 with scrape type 2
2026-03-30 06:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc0a755-e8d6-565a-ae23-49098886fea8 with scrape type 2
2026-03-30 06:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abc0a755-e8d6-565a-ae23-49098886fea8, identifier: CK49467
2026-03-30 06:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-30 06:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-30 06:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467 to the API
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:11Z',
 'fuel_type': 'diesel',
 'id': 'abc0a755-e8d6-565a-ae23-49098886fea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK49467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 84175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2015}
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Saving data for CK49467: {'auction_closing_time': 1774884431.0, 'created_time': 1773225621.316862, 'last_price_update_time': 1774852554.788174}
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK49467') HTTP/1.1" 204 0
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-30 06:35:54 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-30 06:35:54 [auto1.be] INFO: Scrape type for DL17322: 2
2026-03-30 06:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-30 06:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with scrape type 2
2026-03-30 06:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with scrape type 2
2026-03-30 06:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3, identifier: DL17322
2026-03-30 06:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-30 06:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-30 06:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322 to the API
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:47:21Z',
 'fuel_type': 'petrol',
 'id': '94a97b9e-79f0-5685-9957-e63f6c4dc0c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL17322',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Saving data for DL17322: {'auction_closing_time': 1774885641.0, 'created_time': 1774643944.604322, 'last_price_update_time': 1774852555.224983}
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL17322') HTTP/1.1" 204 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for XJ49438: 2
2026-03-30 06:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-30 06:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc460453-e314-5f70-916c-d01b8499e491 with scrape type 2
2026-03-30 06:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc460453-e314-5f70-916c-d01b8499e491 with scrape type 2
2026-03-30 06:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc460453-e314-5f70-916c-d01b8499e491, identifier: XJ49438
2026-03-30 06:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-30 06:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-30 06:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438 to the API
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:51:51Z',
 'fuel_type': 'petrol',
 'id': 'dc460453-e314-5f70-916c-d01b8499e491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ49438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'BMW 1er 116i Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2019}
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Saving data for XJ49438: {'auction_closing_time': 1774885911.0, 'created_time': 1773434128.408951, 'last_price_update_time': 1774852555.80514}
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ49438') HTTP/1.1" 204 0
2026-03-30 06:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-30 06:35:55 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-30 06:35:55 [auto1.be] INFO: Scrape type for AB44644: 2
2026-03-30 06:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-30 06:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7720042d-1a73-513f-8346-94b4dbcccc53 with scrape type 2
2026-03-30 06:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7720042d-1a73-513f-8346-94b4dbcccc53 with scrape type 2
2026-03-30 06:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7720042d-1a73-513f-8346-94b4dbcccc53, identifier: AB44644
2026-03-30 06:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-30 06:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-30 06:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644 to the API
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:09Z',
 'fuel_type': 'petrol',
 'id': '7720042d-1a73-513f-8346-94b4dbcccc53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB44644',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 116152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2018}
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-30 06:35:56 [auto1.be] INFO: Saving data for AB44644: {'auction_closing_time': 1774885089.0, 'created_time': 1773834552.488357, 'last_price_update_time': 1774852556.755337}
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB44644') HTTP/1.1" 204 0
2026-03-30 06:35:56 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1289 | hits on page: 40
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-30 06:35:56 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-30 06:35:56 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-30 06:35:56 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-30 06:35:56 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-30 06:35:56 [auto1.be] INFO: Scrape type for RW94228: 2
2026-03-30 06:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-30 06:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with scrape type 2
2026-03-30 06:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with scrape type 2
2026-03-30 06:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 809dd09e-4224-5e52-aeff-e7f87afe2fd7, identifier: RW94228
2026-03-30 06:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-30 06:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-30 06:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228 to the API
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'petrol',
 'id': '809dd09e-4224-5e52-aeff-e7f87afe2fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW94228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-09',
 'seller_name': None,
 'title': 'BMW 3er 330i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-30 06:35:57 [auto1.be] INFO: Saving data for RW94228: {'auction_closing_time': 1774884516.0, 'created_time': 1773834432.483127, 'last_price_update_time': 1774852557.285998}
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW94228') HTTP/1.1" 204 0
2026-03-30 06:35:57 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-30 06:35:57 [auto1.be] INFO: Scrape type for FE52220: 2
2026-03-30 06:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-30 06:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dea1b79-b33b-5ea2-9059-2d7927825751 with scrape type 2
2026-03-30 06:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dea1b79-b33b-5ea2-9059-2d7927825751 with scrape type 2
2026-03-30 06:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1dea1b79-b33b-5ea2-9059-2d7927825751, identifier: FE52220
2026-03-30 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-30 06:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-30 06:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220 to the API
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:23Z',
 'fuel_type': 'petrol',
 'id': '1dea1b79-b33b-5ea2-9059-2d7927825751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE52220',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 140989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-30 06:35:57 [auto1.be] INFO: Saving data for FE52220: {'auction_closing_time': 1774885643.0, 'created_time': 1774643909.545391, 'last_price_update_time': 1774852557.67937}
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE52220') HTTP/1.1" 204 0
2026-03-30 06:35:57 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-30 06:35:57 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-30 06:35:57 [auto1.be] INFO: Scrape type for YG62523: 2
2026-03-30 06:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-30 06:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997495a0-4c1f-5553-943c-a995e47ef1b5 with scrape type 2
2026-03-30 06:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 997495a0-4c1f-5553-943c-a995e47ef1b5 with scrape type 2
2026-03-30 06:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 997495a0-4c1f-5553-943c-a995e47ef1b5, identifier: YG62523
2026-03-30 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-30 06:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-30 06:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523 to the API
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:25:59Z',
 'fuel_type': 'diesel',
 'id': '997495a0-4c1f-5553-943c-a995e47ef1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG62523',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 240968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-30 06:35:58 [auto1.be] INFO: Saving data for YG62523: {'auction_closing_time': 1774884359.0, 'created_time': 1774643951.171657, 'last_price_update_time': 1774852558.07062}
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG62523') HTTP/1.1" 204 0
2026-03-30 06:35:58 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-30 06:35:58 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-30 06:35:58 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-30 06:35:58 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-30 06:35:58 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-30 06:35:58 [auto1.be] INFO: Scrape type for XC82229: 2
2026-03-30 06:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-30 06:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702e2a30-4411-5c01-9d91-776d01caa249 with scrape type 2
2026-03-30 06:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 702e2a30-4411-5c01-9d91-776d01caa249 with scrape type 2
2026-03-30 06:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 702e2a30-4411-5c01-9d91-776d01caa249, identifier: XC82229
2026-03-30 06:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-30 06:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-30 06:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229 to the API
2026-03-30 06:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:12Z',
 'fuel_type': 'diesel',
 'id': '702e2a30-4411-5c01-9d91-776d01caa249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC82229',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 107341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-30 06:35:59 [auto1.be] INFO: Saving data for XC82229: {'auction_closing_time': 1774882932.0, 'created_time': 1774643905.272469, 'last_price_update_time': 1774852559.456312}
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC82229') HTTP/1.1" 204 0
2026-03-30 06:35:59 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-30 06:35:59 [auto1.be] INFO: Scrape type for ZF47475: 2
2026-03-30 06:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-30 06:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf00e69-3619-56e2-a498-2a546291fd09 with scrape type 2
2026-03-30 06:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebf00e69-3619-56e2-a498-2a546291fd09 with scrape type 2
2026-03-30 06:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebf00e69-3619-56e2-a498-2a546291fd09, identifier: ZF47475
2026-03-30 06:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-30 06:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-30 06:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475 to the API
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:49:42Z',
 'fuel_type': 'diesel',
 'id': 'ebf00e69-3619-56e2-a498-2a546291fd09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF47475',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 181427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-30 06:35:59 [auto1.be] INFO: Saving data for ZF47475: {'auction_closing_time': 1774885782.0, 'created_time': 1774643786.561997, 'last_price_update_time': 1774852559.841824}
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF47475') HTTP/1.1" 204 0
2026-03-30 06:35:59 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-30 06:35:59 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-30 06:35:59 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-30 06:35:59 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-30 06:35:59 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-30 06:35:59 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-30 06:35:59 [auto1.be] INFO: Scrape type for PN18532: 2
2026-03-30 06:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-30 06:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e81558-43ae-5478-9dee-39cbb0b045e4 with scrape type 2
2026-03-30 06:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e81558-43ae-5478-9dee-39cbb0b045e4 with scrape type 2
2026-03-30 06:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25e81558-43ae-5478-9dee-39cbb0b045e4, identifier: PN18532
2026-03-30 06:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-30 06:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-30 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532 to the API
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:35:22Z',
 'fuel_type': 'petrol',
 'id': '25e81558-43ae-5478-9dee-39cbb0b045e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN18532',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 100802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-18',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Saving data for PN18532: {'auction_closing_time': 1774884922.0, 'created_time': 1774643743.681616, 'last_price_update_time': 1774852560.284983}
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN18532') HTTP/1.1" 204 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-30 06:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:00 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-30 06:36:00 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-30 06:36:00 [auto1.be] INFO: Scrape type for ZJ47299: 2
2026-03-30 06:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-30 06:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b03b22-9027-5a94-8b1f-e3d7022a458c with scrape type 2
2026-03-30 06:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8b03b22-9027-5a94-8b1f-e3d7022a458c with scrape type 2
2026-03-30 06:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b8b03b22-9027-5a94-8b1f-e3d7022a458c, identifier: ZJ47299
2026-03-30 06:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-30 06:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-30 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299 to the API
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'petrol',
 'id': 'b8b03b22-9027-5a94-8b1f-e3d7022a458c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ47299',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 113081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-11',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 MIVEC Invite 2WD',
 'transmission': 'manual',
 'trim': 'Invite 2WD',
 'year': 2015}
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Saving data for ZJ47299: {'auction_closing_time': 1774885702.0, 'created_time': 1774644008.509825, 'last_price_update_time': 1774852561.05144}
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ47299') HTTP/1.1" 204 0
2026-03-30 06:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Scrape type for HA88594: 2
2026-03-30 06:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-30 06:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e262515-9741-5b52-9626-5ac56dd9ee03 with scrape type 2
2026-03-30 06:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e262515-9741-5b52-9626-5ac56dd9ee03 with scrape type 2
2026-03-30 06:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e262515-9741-5b52-9626-5ac56dd9ee03, identifier: HA88594
2026-03-30 06:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-30 06:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-30 06:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594 to the API
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'hybrid',
 'id': '2e262515-9741-5b52-9626-5ac56dd9ee03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88594',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 37987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Saving data for HA88594: {'auction_closing_time': 1774883052.0, 'created_time': 1774557427.949412, 'last_price_update_time': 1774852561.629842}
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HA88594') HTTP/1.1" 204 0
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-30 06:36:01 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-30 06:36:01 [auto1.be] INFO: Scrape type for JZ16543: 2
2026-03-30 06:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-30 06:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0873f4e9-2bac-5146-829e-773bd08d7257 with scrape type 2
2026-03-30 06:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0873f4e9-2bac-5146-829e-773bd08d7257 with scrape type 2
2026-03-30 06:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0873f4e9-2bac-5146-829e-773bd08d7257, identifier: JZ16543
2026-03-30 06:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-30 06:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-30 06:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543 to the API
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'diesel',
 'id': '0873f4e9-2bac-5146-829e-773bd08d7257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ16543',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 235945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-30 06:36:02 [auto1.be] INFO: Saving data for JZ16543: {'auction_closing_time': 1774883872.0, 'created_time': 1774643969.23016, 'last_price_update_time': 1774852562.059647}
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ16543') HTTP/1.1" 204 0
2026-03-30 06:36:02 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-30 06:36:02 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-30 06:36:02 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-30 06:36:02 [auto1.be] INFO: Scrape type for NP17382: 2
2026-03-30 06:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-30 06:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with scrape type 2
2026-03-30 06:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with scrape type 2
2026-03-30 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6, identifier: NP17382
2026-03-30 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-30 06:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382 to the API
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:08:40Z',
 'fuel_type': 'petrol',
 'id': '2c202a75-ed5a-5c64-a1ad-7def648fb7e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP17382',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 17561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-30 06:36:02 [auto1.be] INFO: Saving data for NP17382: {'auction_closing_time': 1774883320.0, 'created_time': 1774643915.565849, 'last_price_update_time': 1774852562.592092}
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP17382') HTTP/1.1" 204 0
2026-03-30 06:36:02 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-30 06:36:02 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-30 06:36:02 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-30 06:36:02 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-30 06:36:02 [auto1.be] INFO: Scrape type for TE72836: 2
2026-03-30 06:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-30 06:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24efa657-a08a-50ea-80cc-535f3b4eac61 with scrape type 2
2026-03-30 06:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24efa657-a08a-50ea-80cc-535f3b4eac61 with scrape type 2
2026-03-30 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24efa657-a08a-50ea-80cc-535f3b4eac61, identifier: TE72836
2026-03-30 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-30 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 06:36:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-30 06:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836 to the API
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:38Z',
 'fuel_type': 'diesel',
 'id': '24efa657-a08a-50ea-80cc-535f3b4eac61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE72836',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-30 06:36:03 [auto1.be] INFO: Saving data for TE72836: {'auction_closing_time': 1774885478.0, 'created_time': 1774643747.114791, 'last_price_update_time': 1774852563.353366}
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE72836') HTTP/1.1" 204 0
2026-03-30 06:36:03 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-30 06:36:03 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-30 06:36:03 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-30 06:36:03 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-30 06:36:03 [auto1.be] INFO: Scrape type for XK75143: 2
2026-03-30 06:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-30 06:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with scrape type 2
2026-03-30 06:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with scrape type 2
2026-03-30 06:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388, identifier: XK75143
2026-03-30 06:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-30 06:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-30 06:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143 to the API
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'diesel',
 'id': '832bc6d3-5079-526e-a8b2-7c0cf7ea5388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK75143',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 56193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Express Maxi',
 'transmission': 'manual',
 'trim': 'Express Maxi',
 'year': 2019}
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-30 06:36:03 [auto1.be] INFO: Saving data for XK75143: {'auction_closing_time': 1774884476.0, 'created_time': 1774557325.150018, 'last_price_update_time': 1774852563.883011}
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK75143') HTTP/1.1" 204 0
2026-03-30 06:36:03 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-30 06:36:03 [auto1.be] INFO: Scrape type for SS18683: 2
2026-03-30 06:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-30 06:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3df223-d8e8-5ca7-b738-87c3dc67237a with scrape type 2
2026-03-30 06:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f3df223-d8e8-5ca7-b738-87c3dc67237a with scrape type 2
2026-03-30 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f3df223-d8e8-5ca7-b738-87c3dc67237a, identifier: SS18683
2026-03-30 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-30 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-30 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683 to the API
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:00Z',
 'fuel_type': 'diesel',
 'id': '1f3df223-d8e8-5ca7-b738-87c3dc67237a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS18683',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 117236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2016}
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-30 06:36:04 [auto1.be] INFO: Saving data for SS18683: {'auction_closing_time': 1774885980.0, 'created_time': 1773434504.189128, 'last_price_update_time': 1774852564.306611}
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SS18683') HTTP/1.1" 204 0
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-30 06:36:04 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-30 06:36:04 [auto1.be] INFO: Scrape type for ZH69808: 2
2026-03-30 06:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-30 06:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cf23860-d8c1-57eb-835e-c370a2654844 with scrape type 2
2026-03-30 06:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cf23860-d8c1-57eb-835e-c370a2654844 with scrape type 2
2026-03-30 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4cf23860-d8c1-57eb-835e-c370a2654844, identifier: ZH69808
2026-03-30 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-30 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-30 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808 to the API
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:30Z',
 'fuel_type': 'petrol',
 'id': '4cf23860-d8c1-57eb-835e-c370a2654844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH69808',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 87875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-30 06:36:04 [auto1.be] INFO: Saving data for ZH69808: {'auction_closing_time': 1774886370.0, 'created_time': 1774557332.681902, 'last_price_update_time': 1774852564.74175}
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH69808') HTTP/1.1" 204 0
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-30 06:36:04 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-30 06:36:04 [auto1.be] INFO: Scrape type for DY96127: 2
2026-03-30 06:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-30 06:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with scrape type 2
2026-03-30 06:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with scrape type 2
2026-03-30 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e, identifier: DY96127
2026-03-30 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-30 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-30 06:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127 to the API
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'petrol',
 'id': 'f0ab4ea5-3f2b-5460-bfa1-5d501721e97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY96127',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 265005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-20',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-30 06:36:05 [auto1.be] INFO: Saving data for DY96127: {'auction_closing_time': 1774884220.0, 'created_time': 1774643956.898777, 'last_price_update_time': 1774852565.274534}
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY96127') HTTP/1.1" 204 0
2026-03-30 06:36:05 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-30 06:36:05 [auto1.be] INFO: Scrape type for HT10085: 2
2026-03-30 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-30 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 with scrape type 2
2026-03-30 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 with scrape type 2
2026-03-30 06:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93ffbcec-e498-5381-a1c2-87246a33d0b6, identifier: HT10085
2026-03-30 06:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 06:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-30 06:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085 to the API
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:06:16Z',
 'fuel_type': 'petrol',
 'id': '93ffbcec-e498-5381-a1c2-87246a33d0b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT10085',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 207199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-30 06:36:05 [auto1.be] INFO: Saving data for HT10085: {'auction_closing_time': 1774883176.0, 'created_time': 1774643943.914207, 'last_price_update_time': 1774852565.880239}
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT10085') HTTP/1.1" 204 0
2026-03-30 06:36:05 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-30 06:36:05 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-30 06:36:05 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-30 06:36:05 [auto1.be] INFO: Scrape type for DP96261: 2
2026-03-30 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-30 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9e1707-ded2-5554-ba55-00530f25d636 with scrape type 2
2026-03-30 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9e1707-ded2-5554-ba55-00530f25d636 with scrape type 2
2026-03-30 06:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a9e1707-ded2-5554-ba55-00530f25d636, identifier: DP96261
2026-03-30 06:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-30 06:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-30 06:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261 to the API
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:28:50Z',
 'fuel_type': 'petrol',
 'id': '2a9e1707-ded2-5554-ba55-00530f25d636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP96261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 42409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-30 06:36:06 [auto1.be] INFO: Saving data for DP96261: {'auction_closing_time': 1774884530.0, 'created_time': 1773909329.691701, 'last_price_update_time': 1774852566.33228}
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP96261') HTTP/1.1" 204 0
2026-03-30 06:36:06 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:06 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-30 06:36:06 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-30 06:36:06 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-30 06:36:06 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-30 06:36:06 [auto1.be] INFO: Scrape type for MD04738: 2
2026-03-30 06:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-30 06:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fb81f7-38f0-5f29-acdd-c733dca943cc with scrape type 2
2026-03-30 06:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0fb81f7-38f0-5f29-acdd-c733dca943cc with scrape type 2
2026-03-30 06:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0fb81f7-38f0-5f29-acdd-c733dca943cc, identifier: MD04738
2026-03-30 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-30 06:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-30 06:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738 to the API
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'petrol',
 'id': 'c0fb81f7-38f0-5f29-acdd-c733dca943cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD04738',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-30 06:36:06 [auto1.be] INFO: Saving data for MD04738: {'auction_closing_time': 1774885433.0, 'created_time': 1773650180.943265, 'last_price_update_time': 1774852566.785247}
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD04738') HTTP/1.1" 204 0
2026-03-30 06:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:06 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-30 06:36:06 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-30 06:36:06 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-30 06:36:06 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-30 06:36:06 [auto1.be] INFO: Scrape type for NW54949: 2
2026-03-30 06:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-30 06:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff1ab37-6112-5b13-a202-a694b65a0e9c with scrape type 2
2026-03-30 06:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff1ab37-6112-5b13-a202-a694b65a0e9c with scrape type 2
2026-03-30 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ff1ab37-6112-5b13-a202-a694b65a0e9c, identifier: NW54949
2026-03-30 06:36:07 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 25 pages/min), scraped 62 items (at 62 items/min)
2026-03-30 06:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-30 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-30 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949 to the API
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:27Z',
 'fuel_type': 'diesel',
 'id': '5ff1ab37-6112-5b13-a202-a694b65a0e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW54949',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 117371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-03',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Saving data for NW54949: {'auction_closing_time': 1774884507.0, 'created_time': 1774643935.343815, 'last_price_update_time': 1774852567.356507}
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NW54949') HTTP/1.1" 204 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for CW40114: 2
2026-03-30 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-30 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with scrape type 2
2026-03-30 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with scrape type 2
2026-03-30 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae, identifier: CW40114
2026-03-30 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-30 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-30 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114 to the API
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:34Z',
 'fuel_type': 'petrol',
 'id': '6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW40114',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 153710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Saving data for CW40114: {'auction_closing_time': 1774886134.0, 'created_time': 1773434141.608684, 'last_price_update_time': 1774852567.779818}
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW40114') HTTP/1.1" 204 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-30 06:36:07 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-30 06:36:07 [auto1.be] INFO: Scrape type for HP74170: 2
2026-03-30 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-30 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 with scrape type 2
2026-03-30 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 with scrape type 2
2026-03-30 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58d190d7-ae2b-59be-b179-cfe65922cfe0, identifier: HP74170
2026-03-30 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-30 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-30 06:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170 to the API
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:29:18Z',
 'fuel_type': 'diesel',
 'id': '58d190d7-ae2b-59be-b179-cfe65922cfe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP74170',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 151930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-30 06:36:08 [auto1.be] INFO: Saving data for HP74170: {'auction_closing_time': 1774884558.0, 'created_time': 1774643991.307399, 'last_price_update_time': 1774852568.300971}
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP74170') HTTP/1.1" 204 0
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-30 06:36:08 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-30 06:36:08 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-30 06:36:08 [auto1.be] INFO: Scrape type for HX42019: 2
2026-03-30 06:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-30 06:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with scrape type 2
2026-03-30 06:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with scrape type 2
2026-03-30 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47, identifier: HX42019
2026-03-30 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-30 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-30 06:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019 to the API
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'petrol',
 'id': '7805f9c5-0726-5cdf-9ffa-e191aefa6f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX42019',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 16623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-27',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2024}
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-30 06:36:08 [auto1.be] INFO: Saving data for HX42019: {'auction_closing_time': 1774884351.0, 'created_time': 1774643857.9698, 'last_price_update_time': 1774852568.858204}
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX42019') HTTP/1.1" 204 0
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-30 06:36:08 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-30 06:36:08 [auto1.be] INFO: Scrape type for SV05686: 2
2026-03-30 06:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-30 06:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with scrape type 2
2026-03-30 06:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with scrape type 2
2026-03-30 06:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f, identifier: SV05686
2026-03-30 06:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-30 06:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-30 06:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686 to the API
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:52:10Z',
 'fuel_type': 'diesel',
 'id': '3a7e7a30-1a97-5eda-99e4-49a3405a0d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV05686',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 206571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Saving data for SV05686: {'auction_closing_time': 1774885930.0, 'created_time': 1774557355.409705, 'last_price_update_time': 1774852569.305047}
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV05686') HTTP/1.1" 204 0
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-30 06:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:09 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-30 06:36:09 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Scrape type for JJ27182: 2
2026-03-30 06:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-30 06:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with scrape type 2
2026-03-30 06:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with scrape type 2
2026-03-30 06:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3, identifier: JJ27182
2026-03-30 06:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-30 06:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-30 06:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182 to the API
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:35:15Z',
 'fuel_type': 'diesel',
 'id': '1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ27182',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 238550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-30 06:36:09 [auto1.be] INFO: Saving data for JJ27182: {'auction_closing_time': 1774884915.0, 'created_time': 1774644016.994636, 'last_price_update_time': 1774852569.97358}
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ27182') HTTP/1.1" 204 0
2026-03-30 06:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for CD53749: 2
2026-03-30 06:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-30 06:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340357b4-4fa8-5a28-b374-517e6f18c66f with scrape type 2
2026-03-30 06:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340357b4-4fa8-5a28-b374-517e6f18c66f with scrape type 2
2026-03-30 06:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 340357b4-4fa8-5a28-b374-517e6f18c66f, identifier: CD53749
2026-03-30 06:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-30 06:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-30 06:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749 to the API
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:53Z',
 'fuel_type': 'diesel',
 'id': '340357b4-4fa8-5a28-b374-517e6f18c66f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD53749',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 269576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-02',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Saving data for CD53749: {'auction_closing_time': 1774884893.0, 'created_time': 1773909331.016785, 'last_price_update_time': 1774852570.51199}
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD53749') HTTP/1.1" 204 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-30 06:36:10 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-30 06:36:10 [auto1.be] INFO: Scrape type for KV01738: 2
2026-03-30 06:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-30 06:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b819f3-ff35-5688-95c2-36f44ab7e59e with scrape type 2
2026-03-30 06:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b819f3-ff35-5688-95c2-36f44ab7e59e with scrape type 2
2026-03-30 06:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70b819f3-ff35-5688-95c2-36f44ab7e59e, identifier: KV01738
2026-03-30 06:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-30 06:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-30 06:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738 to the API
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'petrol',
 'id': '70b819f3-ff35-5688-95c2-36f44ab7e59e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV01738',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 216617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Soleil',
 'transmission': 'manual',
 'trim': 'Soleil',
 'year': 2019}
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Saving data for KV01738: {'auction_closing_time': 1774885312.0, 'created_time': 1774643832.341837, 'last_price_update_time': 1774852571.071766}
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV01738') HTTP/1.1" 204 0
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Scrape type for UW52037: 2
2026-03-30 06:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-30 06:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 540272db-9b64-5856-bc7b-f4976cdce59c with scrape type 2
2026-03-30 06:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 540272db-9b64-5856-bc7b-f4976cdce59c with scrape type 2
2026-03-30 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 540272db-9b64-5856-bc7b-f4976cdce59c, identifier: UW52037
2026-03-30 06:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-30 06:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-30 06:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037 to the API
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'diesel',
 'id': '540272db-9b64-5856-bc7b-f4976cdce59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW52037',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 199524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D3 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2020}
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Saving data for UW52037: {'auction_closing_time': 1774883382.0, 'created_time': 1774643955.692586, 'last_price_update_time': 1774852571.568111}
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW52037') HTTP/1.1" 204 0
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-30 06:36:11 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-30 06:36:11 [auto1.be] INFO: Scrape type for RY14212: 2
2026-03-30 06:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-30 06:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 292d0c5d-e39e-5805-8c93-a44125c26007 with scrape type 2
2026-03-30 06:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 292d0c5d-e39e-5805-8c93-a44125c26007 with scrape type 2
2026-03-30 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 292d0c5d-e39e-5805-8c93-a44125c26007, identifier: RY14212
2026-03-30 06:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-30 06:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-30 06:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212 to the API
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'petrol',
 'id': '292d0c5d-e39e-5805-8c93-a44125c26007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY14212',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 215442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2016}
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Saving data for RY14212: {'auction_closing_time': 1774885507.0, 'created_time': 1773909358.160747, 'last_price_update_time': 1774852572.051593}
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY14212') HTTP/1.1" 204 0
2026-03-30 06:36:12 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-30 06:36:12 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Scrape type for EL33380: 2
2026-03-30 06:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-30 06:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9750c431-3c7c-5715-be03-3746c097c497 with scrape type 2
2026-03-30 06:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9750c431-3c7c-5715-be03-3746c097c497 with scrape type 2
2026-03-30 06:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9750c431-3c7c-5715-be03-3746c097c497, identifier: EL33380
2026-03-30 06:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-30 06:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-30 06:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380 to the API
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'diesel',
 'id': '9750c431-3c7c-5715-be03-3746c097c497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL33380',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 244350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2013}
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Saving data for EL33380: {'auction_closing_time': 1774883655.0, 'created_time': 1774557425.860054, 'last_price_update_time': 1774852572.504677}
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL33380') HTTP/1.1" 204 0
2026-03-30 06:36:12 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-30 06:36:12 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Scrape type for YK73361: 2
2026-03-30 06:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-30 06:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with scrape type 2
2026-03-30 06:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with scrape type 2
2026-03-30 06:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66f0530b-7bb4-5c75-b619-81fb5fd46d51, identifier: YK73361
2026-03-30 06:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-30 06:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-30 06:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361 to the API
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:09:06Z',
 'fuel_type': 'diesel',
 'id': '66f0530b-7bb4-5c75-b619-81fb5fd46d51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK73361',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 141793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-30 06:36:12 [auto1.be] INFO: Saving data for YK73361: {'auction_closing_time': 1774883346.0, 'created_time': 1774557324.647236, 'last_price_update_time': 1774852572.923689}
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK73361') HTTP/1.1" 204 0
2026-03-30 06:36:13 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-30 06:36:13 [auto1.be] INFO: Scrape type for FF99790: 2
2026-03-30 06:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-30 06:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc4450d-a9da-53ea-b379-ffb0596c3043 with scrape type 2
2026-03-30 06:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc4450d-a9da-53ea-b379-ffb0596c3043 with scrape type 2
2026-03-30 06:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fc4450d-a9da-53ea-b379-ffb0596c3043, identifier: FF99790
2026-03-30 06:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-30 06:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-30 06:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790 to the API
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:56:39Z',
 'fuel_type': 'petrol',
 'id': '6fc4450d-a9da-53ea-b379-ffb0596c3043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF99790',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 112770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-30 06:36:13 [auto1.be] INFO: Saving data for FF99790: {'auction_closing_time': 1774886199.0, 'created_time': 1774557417.582953, 'last_price_update_time': 1774852573.394724}
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF99790') HTTP/1.1" 204 0
2026-03-30 06:36:13 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-30 06:36:13 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-30 06:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:14 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-30 06:36:14 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-30 06:36:14 [auto1.be] INFO: Scrape type for CU87114: 2
2026-03-30 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-30 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with scrape type 2
2026-03-30 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with scrape type 2
2026-03-30 06:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050, identifier: CU87114
2026-03-30 06:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-30 06:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-30 06:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114 to the API
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:09Z',
 'fuel_type': 'petrol',
 'id': '75dcc80f-8bf9-5b99-a0ef-027f97a8b050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU87114',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 17473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2021}
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-30 06:36:14 [auto1.be] INFO: Saving data for CU87114: {'auction_closing_time': 1774883289.0, 'created_time': 1773520652.9053, 'last_price_update_time': 1774852574.709122}
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU87114') HTTP/1.1" 204 0
2026-03-30 06:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-30 06:36:14 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-30 06:36:14 [auto1.be] INFO: Scrape type for BV41613: 2
2026-03-30 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-30 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with scrape type 2
2026-03-30 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with scrape type 2
2026-03-30 06:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78, identifier: BV41613
2026-03-30 06:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-30 06:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-30 06:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613 to the API
2026-03-30 06:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:53Z',
 'fuel_type': 'diesel',
 'id': '887d96fd-a4ef-5610-a527-9ed2c3b6ff78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV41613',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 229780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-07',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Saving data for BV41613: {'auction_closing_time': 1774885553.0, 'created_time': 1774644015.360964, 'last_price_update_time': 1774852575.120004}
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV41613') HTTP/1.1" 204 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for PJ20685: 2
2026-03-30 06:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-30 06:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with scrape type 2
2026-03-30 06:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with scrape type 2
2026-03-30 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a34909d-0f97-58e7-afcb-02caf3ffeb80, identifier: PJ20685
2026-03-30 06:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-30 06:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-30 06:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685 to the API
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:48:51Z',
 'fuel_type': 'petrol',
 'id': '0a34909d-0f97-58e7-afcb-02caf3ffeb80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ20685',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 43724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Saving data for PJ20685: {'auction_closing_time': 1774885731.0, 'created_time': 1773239954.362352, 'last_price_update_time': 1774852575.681076}
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ20685') HTTP/1.1" 204 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-30 06:36:15 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-30 06:36:15 [auto1.be] INFO: Scrape type for CV26650: 2
2026-03-30 06:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-30 06:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with scrape type 2
2026-03-30 06:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with scrape type 2
2026-03-30 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d, identifier: CV26650
2026-03-30 06:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:36:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 06:36:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-30 06:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650 to the API
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:21:49Z',
 'fuel_type': 'petrol',
 'id': '053ddd54-7cb9-5f6c-9a40-f0f2df12153d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV26650',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 123722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-03',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Saving data for CV26650: {'auction_closing_time': 1774884109.0, 'created_time': 1774557460.89487, 'last_price_update_time': 1774852576.291581}
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV26650') HTTP/1.1" 204 0
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Scrape type for RU10603: 2
2026-03-30 06:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-30 06:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8508898-f2f2-5c2f-af7f-49a19194831b with scrape type 2
2026-03-30 06:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8508898-f2f2-5c2f-af7f-49a19194831b with scrape type 2
2026-03-30 06:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8508898-f2f2-5c2f-af7f-49a19194831b, identifier: RU10603
2026-03-30 06:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-30 06:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-30 06:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603 to the API
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:32Z',
 'fuel_type': 'diesel',
 'id': 'e8508898-f2f2-5c2f-af7f-49a19194831b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU10603',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 111369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2017}
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Saving data for RU10603: {'auction_closing_time': 1774886192.0, 'created_time': 1774643911.13316, 'last_price_update_time': 1774852576.842082}
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU10603') HTTP/1.1" 204 0
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-30 06:36:16 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-30 06:36:16 [auto1.be] INFO: Scrape type for KW80684: 2
2026-03-30 06:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-30 06:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with scrape type 2
2026-03-30 06:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with scrape type 2
2026-03-30 06:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9, identifier: KW80684
2026-03-30 06:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-30 06:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-30 06:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684 to the API
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:54Z',
 'fuel_type': 'diesel',
 'id': '13bd6a3b-311f-5798-9dfb-de19fc97f8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW80684',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'FR-V',
 'odometer': 202431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-11',
 'seller_name': None,
 'title': 'Honda FR-V 2.2 CTDI CTDi Comfort',
 'transmission': 'manual',
 'trim': 'CTDi Comfort',
 'year': 2006}
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-30 06:36:17 [auto1.be] INFO: Saving data for KW80684: {'auction_closing_time': 1774883514.0, 'created_time': 1774557323.389532, 'last_price_update_time': 1774852577.230423}
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW80684') HTTP/1.1" 204 0
2026-03-30 06:36:17 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-30 06:36:17 [auto1.be] INFO: Scrape type for LF90651: 2
2026-03-30 06:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-30 06:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bbf32d6-3e0d-599b-a271-8b7b1595182f with scrape type 2
2026-03-30 06:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bbf32d6-3e0d-599b-a271-8b7b1595182f with scrape type 2
2026-03-30 06:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bbf32d6-3e0d-599b-a271-8b7b1595182f, identifier: LF90651
2026-03-30 06:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-30 06:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-30 06:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651 to the API
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:14:58Z',
 'fuel_type': 'petrol',
 'id': '1bbf32d6-3e0d-599b-a271-8b7b1595182f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF90651',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Courier',
 'odometer': 4418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Ford Transit Courier 1.0 EcoBoost Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-30 06:36:17 [auto1.be] INFO: Saving data for LF90651: {'auction_closing_time': 1774883698.0, 'created_time': 1773953495.093067, 'last_price_update_time': 1774852577.730165}
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF90651') HTTP/1.1" 204 0
2026-03-30 06:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:20 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Scrape type for BV36868: 2
2026-03-30 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-30 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3744e4b7-4e40-5aa2-86da-4e72845af362 with scrape type 2
2026-03-30 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3744e4b7-4e40-5aa2-86da-4e72845af362 with scrape type 2
2026-03-30 06:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3744e4b7-4e40-5aa2-86da-4e72845af362, identifier: BV36868
2026-03-30 06:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-30 06:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-30 06:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868 to the API
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:20:01Z',
 'fuel_type': 'diesel',
 'id': '3744e4b7-4e40-5aa2-86da-4e72845af362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV36868',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2022}
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Saving data for BV36868: {'auction_closing_time': 1774884001.0, 'created_time': 1774557585.881787, 'last_price_update_time': 1774852580.489202}
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV36868') HTTP/1.1" 204 0
2026-03-30 06:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Scrape type for RM32931: 2
2026-03-30 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-30 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with scrape type 2
2026-03-30 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with scrape type 2
2026-03-30 06:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f, identifier: RM32931
2026-03-30 06:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-30 06:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-30 06:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931 to the API
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:52:07Z',
 'fuel_type': 'diesel',
 'id': '3c39c42e-0bc5-53aa-bda9-b92d0c77374f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM32931',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Navara Pick-up',
 'odometer': 89671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Nissan Navara Pick-up 3.0 V6 dCi Double Cab LE 4x4',
 'transmission': 'automatic',
 'trim': 'Double Cab LE 4x4',
 'year': 2016}
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Saving data for RM32931: {'auction_closing_time': 1774885927.0, 'created_time': 1774643908.183247, 'last_price_update_time': 1774852580.910985}
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM32931') HTTP/1.1" 204 0
2026-03-30 06:36:20 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-30 06:36:20 [auto1.be] INFO: Scrape type for SK81997: 2
2026-03-30 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-30 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with scrape type 2
2026-03-30 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with scrape type 2
2026-03-30 06:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56177e08-6d3d-5481-9f0b-adbc9eeaede2, identifier: SK81997
2026-03-30 06:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-30 06:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-30 06:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997 to the API
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'diesel',
 'id': '56177e08-6d3d-5481-9f0b-adbc9eeaede2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK81997',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 169952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D3 Linje Svart',
 'transmission': 'manual',
 'trim': 'Linje Svart',
 'year': 2018}
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-30 06:36:21 [auto1.be] INFO: Saving data for SK81997: {'auction_closing_time': 1774884877.0, 'created_time': 1773909335.342104, 'last_price_update_time': 1774852581.379008}
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK81997') HTTP/1.1" 204 0
2026-03-30 06:36:21 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-30 06:36:21 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-30 06:36:21 [auto1.be] INFO: Scrape type for PJ31589: 2
2026-03-30 06:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-30 06:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with scrape type 2
2026-03-30 06:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with scrape type 2
2026-03-30 06:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb, identifier: PJ31589
2026-03-30 06:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-30 06:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-30 06:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589 to the API
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'diesel',
 'id': '6f7d4129-2e6e-51ba-ab9d-98e84cffadfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ31589',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 130985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.7 BLUE dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-30 06:36:21 [auto1.be] INFO: Saving data for PJ31589: {'auction_closing_time': 1774884424.0, 'created_time': 1774557420.949152, 'last_price_update_time': 1774852581.759669}
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ31589') HTTP/1.1" 204 0
2026-03-30 06:36:21 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-30 06:36:21 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-30 06:36:21 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-30 06:36:21 [auto1.be] INFO: Scrape type for UF59925: 2
2026-03-30 06:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-30 06:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb397cae-cd70-5757-9a4a-4f90035e4674 with scrape type 2
2026-03-30 06:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb397cae-cd70-5757-9a4a-4f90035e4674 with scrape type 2
2026-03-30 06:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb397cae-cd70-5757-9a4a-4f90035e4674, identifier: UF59925
2026-03-30 06:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-30 06:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-30 06:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925 to the API
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:04:04Z',
 'fuel_type': 'diesel',
 'id': 'bb397cae-cd70-5757-9a4a-4f90035e4674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF59925',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 120472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Saving data for UF59925: {'auction_closing_time': 1774883044.0, 'created_time': 1774643999.091058, 'last_price_update_time': 1774852582.287676}
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF59925') HTTP/1.1" 204 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for BC32945: 2
2026-03-30 06:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-30 06:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e536945-6c61-5a8b-b098-29e70071a9f5 with scrape type 2
2026-03-30 06:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e536945-6c61-5a8b-b098-29e70071a9f5 with scrape type 2
2026-03-30 06:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e536945-6c61-5a8b-b098-29e70071a9f5, identifier: BC32945
2026-03-30 06:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-30 06:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-30 06:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945 to the API
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 350,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'petrol',
 'id': '0e536945-6c61-5a8b-b098-29e70071a9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC32945',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 110020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 TwinTurbo Gran Lusso Q4',
 'transmission': 'automatic',
 'trim': 'Gran Lusso Q4',
 'year': 2019}
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Saving data for BC32945: {'auction_closing_time': 1774885320.0, 'created_time': 1774643823.52297, 'last_price_update_time': 1774852582.867717}
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC32945') HTTP/1.1" 204 0
2026-03-30 06:36:22 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-30 06:36:22 [auto1.be] INFO: Scrape type for NB71425: 2
2026-03-30 06:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-30 06:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a057a9dc-fb8e-5001-997b-63384be95c51 with scrape type 2
2026-03-30 06:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a057a9dc-fb8e-5001-997b-63384be95c51 with scrape type 2
2026-03-30 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a057a9dc-fb8e-5001-997b-63384be95c51, identifier: NB71425
2026-03-30 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-30 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-30 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425 to the API
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:45Z',
 'fuel_type': 'diesel',
 'id': 'a057a9dc-fb8e-5001-997b-63384be95c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB71425',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 107273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-30 06:36:23 [auto1.be] INFO: Saving data for NB71425: {'auction_closing_time': 1774885905.0, 'created_time': 1773240638.008076, 'last_price_update_time': 1774852583.36003}
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB71425') HTTP/1.1" 204 0
2026-03-30 06:36:23 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-30 06:36:23 [auto1.be] INFO: Scrape type for HJ67440: 2
2026-03-30 06:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-30 06:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22cd2476-acf9-5223-8aac-b88702901fdc with scrape type 2
2026-03-30 06:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22cd2476-acf9-5223-8aac-b88702901fdc with scrape type 2
2026-03-30 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22cd2476-acf9-5223-8aac-b88702901fdc, identifier: HJ67440
2026-03-30 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-30 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-30 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440 to the API
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:44:39Z',
 'fuel_type': 'diesel',
 'id': '22cd2476-acf9-5223-8aac-b88702901fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ67440',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 157735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport D250 Mild-Hybrid HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2021}
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-30 06:36:23 [auto1.be] INFO: Saving data for HJ67440: {'auction_closing_time': 1774885479.0, 'created_time': 1774557327.728909, 'last_price_update_time': 1774852583.754872}
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ67440') HTTP/1.1" 204 0
2026-03-30 06:36:23 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-30 06:36:23 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-30 06:36:23 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-30 06:36:23 [auto1.be] INFO: Scrape type for EF70909: 2
2026-03-30 06:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-30 06:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89689ae0-27af-5545-bbd7-6643c93415f9 with scrape type 2
2026-03-30 06:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89689ae0-27af-5545-bbd7-6643c93415f9 with scrape type 2
2026-03-30 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89689ae0-27af-5545-bbd7-6643c93415f9, identifier: EF70909
2026-03-30 06:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-30 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-30 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909 to the API
2026-03-30 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:28Z',
 'fuel_type': 'petrol',
 'id': '89689ae0-27af-5545-bbd7-6643c93415f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF70909',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 93238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Saving data for EF70909: {'auction_closing_time': 1774885768.0, 'created_time': 1773909340.992138, 'last_price_update_time': 1774852584.171062}
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EF70909') HTTP/1.1" 204 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for PN62826: 2
2026-03-30 06:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-30 06:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with scrape type 2
2026-03-30 06:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with scrape type 2
2026-03-30 06:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc, identifier: PN62826
2026-03-30 06:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-30 06:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-30 06:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826 to the API
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:08:18Z',
 'fuel_type': 'diesel',
 'id': '2f7bdd03-0d22-594a-99ea-d3e40a3907dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN62826',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 437968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
 'transmission': 'manual',
 'trim': 'T Avantgarde',
 'year': 2007}
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Saving data for PN62826: {'auction_closing_time': 1774883298.0, 'created_time': 1773693391.897711, 'last_price_update_time': 1774852584.549361}
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN62826') HTTP/1.1" 204 0
2026-03-30 06:36:24 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-30 06:36:24 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-30 06:36:24 [auto1.be] INFO: Scrape type for NK56969: 2
2026-03-30 06:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-30 06:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b69580-4a85-5b00-afa1-c61fd457ef90 with scrape type 2
2026-03-30 06:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b69580-4a85-5b00-afa1-c61fd457ef90 with scrape type 2
2026-03-30 06:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 57b69580-4a85-5b00-afa1-c61fd457ef90, identifier: NK56969
2026-03-30 06:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-30 06:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-30 06:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969 to the API
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:38Z',
 'fuel_type': 'petrol',
 'id': '57b69580-4a85-5b00-afa1-c61fd457ef90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK56969',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 73009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-30 06:36:25 [auto1.be] INFO: Saving data for NK56969: {'auction_closing_time': 1774886258.0, 'created_time': 1773240401.028257, 'last_price_update_time': 1774852585.102093}
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK56969') HTTP/1.1" 204 0
2026-03-30 06:36:25 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-30 06:36:25 [auto1.be] INFO: Scrape type for MT09894: 2
2026-03-30 06:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-30 06:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with scrape type 2
2026-03-30 06:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with scrape type 2
2026-03-30 06:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09e36a63-89b1-5ad1-a527-9d17f6ca5750, identifier: MT09894
2026-03-30 06:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-30 06:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-30 06:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894 to the API
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:20Z',
 'fuel_type': 'petrol',
 'id': '09e36a63-89b1-5ad1-a527-9d17f6ca5750',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT09894',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 71076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 Turbo Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2016}
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-30 06:36:25 [auto1.be] INFO: Saving data for MT09894: {'auction_closing_time': 1774885820.0, 'created_time': 1774643796.670155, 'last_price_update_time': 1774852585.574681}
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MT09894') HTTP/1.1" 204 0
2026-03-30 06:36:25 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-30 06:36:25 [auto1.be] INFO: Scrape type for ZF81780: 2
2026-03-30 06:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-30 06:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with scrape type 2
2026-03-30 06:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with scrape type 2
2026-03-30 06:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd, identifier: ZF81780
2026-03-30 06:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-30 06:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-30 06:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780 to the API
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'diesel',
 'id': '41a330b3-77fb-5f45-a13c-30c8a3ef8bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF81780',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 117277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi HDi',
 'transmission': 'manual',
 'trim': 'HDi',
 'year': 2015}
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-30 06:36:25 [auto1.be] INFO: Saving data for ZF81780: {'auction_closing_time': 1774883505.0, 'created_time': 1773224453.84415, 'last_price_update_time': 1774852585.971439}
2026-03-30 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF81780') HTTP/1.1" 204 0
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Scrape type for WB76864: 2
2026-03-30 06:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-30 06:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 825dd81e-9076-5079-9d23-98c279b4786f with scrape type 2
2026-03-30 06:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 825dd81e-9076-5079-9d23-98c279b4786f with scrape type 2
2026-03-30 06:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 825dd81e-9076-5079-9d23-98c279b4786f, identifier: WB76864
2026-03-30 06:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-30 06:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-30 06:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864 to the API
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'diesel',
 'id': '825dd81e-9076-5079-9d23-98c279b4786f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB76864',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 109364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2017}
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Saving data for WB76864: {'auction_closing_time': 1774884351.0, 'created_time': 1774557353.277715, 'last_price_update_time': 1774852586.366084}
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WB76864') HTTP/1.1" 204 0
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Scrape type for ET18736: 2
2026-03-30 06:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-30 06:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3247b2e-7a95-55d9-9f26-c42622767438 with scrape type 2
2026-03-30 06:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3247b2e-7a95-55d9-9f26-c42622767438 with scrape type 2
2026-03-30 06:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3247b2e-7a95-55d9-9f26-c42622767438, identifier: ET18736
2026-03-30 06:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-30 06:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-30 06:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736 to the API
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:07Z',
 'fuel_type': 'diesel',
 'id': 'a3247b2e-7a95-55d9-9f26-c42622767438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET18736',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Business Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Edition Start/Stop',
 'year': 2017}
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Saving data for ET18736: {'auction_closing_time': 1774885747.0, 'created_time': 1774643918.277404, 'last_price_update_time': 1774852586.764594}
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET18736') HTTP/1.1" 204 0
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-30 06:36:26 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-30 06:36:26 [auto1.be] INFO: Scrape type for VW08902: 2
2026-03-30 06:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-30 06:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f4240f-d01b-514a-851b-e9a4f9711b5d with scrape type 2
2026-03-30 06:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f4240f-d01b-514a-851b-e9a4f9711b5d with scrape type 2
2026-03-30 06:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43f4240f-d01b-514a-851b-e9a4f9711b5d, identifier: VW08902
2026-03-30 06:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:36:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-30 06:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902 to the API
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:18:45Z',
 'fuel_type': 'gas',
 'id': '43f4240f-d01b-514a-851b-e9a4f9711b5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW08902',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 63942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-04',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-30 06:36:27 [auto1.be] INFO: Saving data for VW08902: {'auction_closing_time': 1774883925.0, 'created_time': 1774557488.841466, 'last_price_update_time': 1774852587.316515}
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW08902') HTTP/1.1" 204 0
2026-03-30 06:36:27 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-30 06:36:27 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-30 06:36:27 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-30 06:36:27 [auto1.be] INFO: Scrape type for FS38787: 2
2026-03-30 06:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-30 06:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b492033-8422-51be-bbf0-0322a3f6da80 with scrape type 2
2026-03-30 06:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b492033-8422-51be-bbf0-0322a3f6da80 with scrape type 2
2026-03-30 06:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b492033-8422-51be-bbf0-0322a3f6da80, identifier: FS38787
2026-03-30 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-30 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-30 06:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787 to the API
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'diesel',
 'id': '5b492033-8422-51be-bbf0-0322a3f6da80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS38787',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 220154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-10',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2011}
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-30 06:36:27 [auto1.be] INFO: Saving data for FS38787: {'auction_closing_time': 1774883861.0, 'created_time': 1774643906.427234, 'last_price_update_time': 1774852587.715633}
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS38787') HTTP/1.1" 204 0
2026-03-30 06:36:27 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-30 06:36:27 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-30 06:36:27 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-30 06:36:27 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-30 06:36:27 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-30 06:36:27 [auto1.be] INFO: Scrape type for VU16052: 2
2026-03-30 06:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-30 06:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with scrape type 2
2026-03-30 06:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with scrape type 2
2026-03-30 06:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e, identifier: VU16052
2026-03-30 06:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-30 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-30 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052 to the API
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'diesel',
 'id': '262bea1c-b4eb-5202-a36b-4a2e9465aa0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU16052',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 95545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 D250 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-30 06:36:28 [auto1.be] INFO: Saving data for VU16052: {'auction_closing_time': 1774884960.0, 'created_time': 1774557558.197452, 'last_price_update_time': 1774852588.215344}
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU16052') HTTP/1.1" 204 0
2026-03-30 06:36:28 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-30 06:36:28 [auto1.be] INFO: Scrape type for HM47736: 2
2026-03-30 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-30 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17002efe-7880-5c23-ba84-ffe2498431cb with scrape type 2
2026-03-30 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17002efe-7880-5c23-ba84-ffe2498431cb with scrape type 2
2026-03-30 06:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17002efe-7880-5c23-ba84-ffe2498431cb, identifier: HM47736
2026-03-30 06:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-30 06:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-30 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736 to the API
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-30T15:32:56Z',
 'fuel_type': 'petrol',
 'id': '17002efe-7880-5c23-ba84-ffe2498431cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM47736',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 70589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-03',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-30 06:36:28 [auto1.be] INFO: Saving data for HM47736: {'auction_closing_time': 1774884776.0, 'created_time': 1774644015.818917, 'last_price_update_time': 1774852588.596758}
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM47736') HTTP/1.1" 204 0
2026-03-30 06:36:28 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-30 06:36:28 [auto1.be] INFO: Scrape type for GF03232: 2
2026-03-30 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-30 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with scrape type 2
2026-03-30 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with scrape type 2
2026-03-30 06:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71, identifier: GF03232
2026-03-30 06:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-30 06:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-30 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232 to the API
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:54:30Z',
 'fuel_type': 'diesel',
 'id': '14e2b49a-20f1-5b28-9d7f-68c6d5b2be71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF03232',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 157258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-16',
 'seller_name': None,
 'title': 'BMW 3er 316d Première',
 'transmission': 'manual',
 'trim': 'Première',
 'year': 2010}
2026-03-30 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Saving data for GF03232: {'auction_closing_time': 1774886070.0, 'created_time': 1774557539.585204, 'last_price_update_time': 1774852589.00465}
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF03232') HTTP/1.1" 204 0
2026-03-30 06:36:29 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:29 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Scrape type for UC56570: 0
2026-03-30 06:36:29 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Scrape type for NN67810: 2
2026-03-30 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-30 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with scrape type 2
2026-03-30 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with scrape type 2
2026-03-30 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c, identifier: NN67810
2026-03-30 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-30 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-30 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810 to the API
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:58:38Z',
 'fuel_type': 'hybrid',
 'id': '7c84a2c8-1673-5dc0-b808-2ff7f68abf5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN67810',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 53096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Saving data for NN67810: {'auction_closing_time': 1774886318.0, 'created_time': 1773909343.020222, 'last_price_update_time': 1774852589.417547}
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN67810') HTTP/1.1" 204 0
2026-03-30 06:36:29 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Scrape type for ZF78419: 2
2026-03-30 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-30 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with scrape type 2
2026-03-30 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with scrape type 2
2026-03-30 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f, identifier: ZF78419
2026-03-30 06:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:29 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Scrape type for ZM54686: 2
2026-03-30 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-30 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f965cd-80bc-50d1-8249-4abc3c377c86 with scrape type 2
2026-03-30 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0f965cd-80bc-50d1-8249-4abc3c377c86 with scrape type 2
2026-03-30 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0f965cd-80bc-50d1-8249-4abc3c377c86, identifier: ZM54686
2026-03-30 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-30 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-30 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419 to the API
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:48:43Z',
 'fuel_type': 'diesel',
 'id': '10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF78419',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 190486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TDI Greenline',
 'transmission': 'manual',
 'trim': 'Greenline',
 'year': 2011}
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-30 06:36:29 [auto1.be] INFO: Saving data for ZF78419: {'auction_closing_time': 1774885723.0, 'created_time': 1774643838.420648, 'last_price_update_time': 1774852589.893173}
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF78419') HTTP/1.1" 204 0
2026-03-30 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-30 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-30 06:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686 to the API
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'petrol',
 'id': 'c0f965cd-80bc-50d1-8249-4abc3c377c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54686',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 63877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-30 06:36:30 [auto1.be] INFO: Saving data for ZM54686: {'auction_closing_time': 1774885459.0, 'created_time': 1774643870.438204, 'last_price_update_time': 1774852590.207169}
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM54686') HTTP/1.1" 204 0
2026-03-30 06:36:30 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-30 06:36:30 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-30 06:36:30 [auto1.be] INFO: Scrape type for YM99739: 2
2026-03-30 06:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-30 06:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with scrape type 2
2026-03-30 06:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with scrape type 2
2026-03-30 06:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f8f74be6-f3a6-59bd-bb5e-569e69a5af36, identifier: YM99739
2026-03-30 06:36:30 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-30 06:36:30 [auto1.be] INFO: Scrape type for FE88671: 2
2026-03-30 06:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-30 06:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b57a36-f67c-58ea-80bb-01e854084220 with scrape type 2
2026-03-30 06:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45b57a36-f67c-58ea-80bb-01e854084220 with scrape type 2
2026-03-30 06:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45b57a36-f67c-58ea-80bb-01e854084220, identifier: FE88671
2026-03-30 06:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-30 06:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-30 06:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739 to the API
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:57:18Z',
 'fuel_type': 'diesel',
 'id': 'f8f74be6-f3a6-59bd-bb5e-569e69a5af36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM99739',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 134202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-30 06:36:30 [auto1.be] INFO: Saving data for YM99739: {'auction_closing_time': 1774886238.0, 'created_time': 1774557577.075723, 'last_price_update_time': 1774852590.689526}
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM99739') HTTP/1.1" 204 0
2026-03-30 06:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-30 06:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-30 06:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671 to the API
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'hybrid',
 'id': '45b57a36-f67c-58ea-80bb-01e854084220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE88671',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 71172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Saving data for FE88671: {'auction_closing_time': 1774885062.0, 'created_time': 1774643944.288816, 'last_price_update_time': 1774852591.355297}
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE88671') HTTP/1.1" 204 0
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Scrape type for PS72966: 2
2026-03-30 06:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-30 06:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfac3745-102b-5e51-88ec-ce03459d40c5 with scrape type 2
2026-03-30 06:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfac3745-102b-5e51-88ec-ce03459d40c5 with scrape type 2
2026-03-30 06:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfac3745-102b-5e51-88ec-ce03459d40c5, identifier: PS72966
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-30 06:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-30 06:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-30 06:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966 to the API
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'diesel',
 'id': 'cfac3745-102b-5e51-88ec-ce03459d40c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS72966',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 43817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-25',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Saving data for PS72966: {'auction_closing_time': 1774884605.0, 'created_time': 1774643915.226094, 'last_price_update_time': 1774852591.82463}
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS72966') HTTP/1.1" 204 0
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Scrape type for HF54985: 0
2026-03-30 06:36:31 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-30 06:36:31 [auto1.be] INFO: Scrape type for GH94733: 2
2026-03-30 06:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-30 06:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad6bd01-d645-535d-aa6f-8b8f1581696b with scrape type 2
2026-03-30 06:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad6bd01-d645-535d-aa6f-8b8f1581696b with scrape type 2
2026-03-30 06:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aad6bd01-d645-535d-aa6f-8b8f1581696b, identifier: GH94733
2026-03-30 06:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-30 06:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-30 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733 to the API
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:33:52Z',
 'fuel_type': 'petrol',
 'id': 'aad6bd01-d645-535d-aa6f-8b8f1581696b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH94733',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 77344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'Fiat Punto 1.4 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2015}
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-30 06:36:32 [auto1.be] INFO: Saving data for GH94733: {'auction_closing_time': 1774884832.0, 'created_time': 1774643995.188131, 'last_price_update_time': 1774852592.251806}
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH94733') HTTP/1.1" 204 0
2026-03-30 06:36:32 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-30 06:36:32 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-30 06:36:32 [auto1.be] INFO: Scrape type for FA30680: 2
2026-03-30 06:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-30 06:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc0c507-bfc5-5a88-b516-bd9145a3f34b with scrape type 2
2026-03-30 06:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcc0c507-bfc5-5a88-b516-bd9145a3f34b with scrape type 2
2026-03-30 06:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcc0c507-bfc5-5a88-b516-bd9145a3f34b, identifier: FA30680
2026-03-30 06:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-30 06:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-30 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680 to the API
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:28Z',
 'fuel_type': 'petrol',
 'id': 'dcc0c507-bfc5-5a88-b516-bd9145a3f34b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA30680',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 51850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-17',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2023}
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-30 06:36:32 [auto1.be] INFO: Saving data for FA30680: {'auction_closing_time': 1774884688.0, 'created_time': 1773780035.362044, 'last_price_update_time': 1774852592.745496}
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA30680') HTTP/1.1" 204 0
2026-03-30 06:36:32 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-30 06:36:32 [auto1.be] INFO: Scrape type for WL65720: 2
2026-03-30 06:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-30 06:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with scrape type 2
2026-03-30 06:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with scrape type 2
2026-03-30 06:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2, identifier: WL65720
2026-03-30 06:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-30 06:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-30 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720 to the API
2026-03-30 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:12:38Z',
 'fuel_type': 'diesel',
 'id': '44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL65720',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Saving data for WL65720: {'auction_closing_time': 1774883558.0, 'created_time': 1774643973.099878, 'last_price_update_time': 1774852593.133262}
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL65720') HTTP/1.1" 204 0
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Scrape type for KM67426: 2
2026-03-30 06:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-30 06:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c808e87-a02e-5910-b6c8-b37c9cf35179 with scrape type 2
2026-03-30 06:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c808e87-a02e-5910-b6c8-b37c9cf35179 with scrape type 2
2026-03-30 06:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c808e87-a02e-5910-b6c8-b37c9cf35179, identifier: KM67426
2026-03-30 06:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-30 06:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-30 06:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426 to the API
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:50Z',
 'fuel_type': 'diesel',
 'id': '3c808e87-a02e-5910-b6c8-b37c9cf35179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM67426',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 162410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-09',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2017}
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Saving data for KM67426: {'auction_closing_time': 1774884890.0, 'created_time': 1774557334.218393, 'last_price_update_time': 1774852593.513553}
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM67426') HTTP/1.1" 204 0
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Scrape type for DM52841: 2
2026-03-30 06:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-30 06:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78477a3c-a638-585c-8cb2-230e49297ede with scrape type 2
2026-03-30 06:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78477a3c-a638-585c-8cb2-230e49297ede with scrape type 2
2026-03-30 06:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78477a3c-a638-585c-8cb2-230e49297ede, identifier: DM52841
2026-03-30 06:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-30 06:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-30 06:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841 to the API
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:15:30Z',
 'fuel_type': 'petrol',
 'id': '78477a3c-a638-585c-8cb2-230e49297ede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM52841',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 104842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-27',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Saving data for DM52841: {'auction_closing_time': 1774883730.0, 'created_time': 1774643910.219452, 'last_price_update_time': 1774852593.903839}
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM52841') HTTP/1.1" 204 0
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-30 06:36:33 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-30 06:36:33 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-30 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-30 06:36:34 [auto1.be] INFO: Scrape type for DC47068: 2
2026-03-30 06:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-30 06:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2029733-bfb3-5a35-bf66-e33879308206 with scrape type 2
2026-03-30 06:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2029733-bfb3-5a35-bf66-e33879308206 with scrape type 2
2026-03-30 06:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2029733-bfb3-5a35-bf66-e33879308206, identifier: DC47068
2026-03-30 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-30 06:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-30 06:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068 to the API
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:20:08Z',
 'fuel_type': 'petrol',
 'id': 'd2029733-bfb3-5a35-bf66-e33879308206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC47068',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 105136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-30 06:36:34 [auto1.be] INFO: Saving data for DC47068: {'auction_closing_time': 1774884008.0, 'created_time': 1774557526.424423, 'last_price_update_time': 1774852594.484138}
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC47068') HTTP/1.1" 204 0
2026-03-30 06:36:34 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-30 06:36:34 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-30 06:36:34 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-30 06:36:34 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-30 06:36:34 [auto1.be] INFO: Scrape type for VV25356: 2
2026-03-30 06:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-30 06:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fbf830-2835-5e03-8045-87bd14110175 with scrape type 2
2026-03-30 06:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fbf830-2835-5e03-8045-87bd14110175 with scrape type 2
2026-03-30 06:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98fbf830-2835-5e03-8045-87bd14110175, identifier: VV25356
2026-03-30 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-30 06:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-30 06:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356 to the API
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:27:02Z',
 'fuel_type': 'diesel',
 'id': '98fbf830-2835-5e03-8045-87bd14110175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV25356',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 49681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Saving data for VV25356: {'auction_closing_time': 1774884422.0, 'created_time': 1773822949.693674, 'last_price_update_time': 1774852595.022163}
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV25356') HTTP/1.1" 204 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for GS99704: 2
2026-03-30 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-30 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 with scrape type 2
2026-03-30 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 with scrape type 2
2026-03-30 06:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b974b1b6-19de-5e7d-90b5-ef53ef835da4, identifier: GS99704
2026-03-30 06:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-30 06:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-30 06:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704 to the API
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'diesel',
 'id': 'b974b1b6-19de-5e7d-90b5-ef53ef835da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS99704',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 161000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Saving data for GS99704: {'auction_closing_time': 1774884960.0, 'created_time': 1774643989.007071, 'last_price_update_time': 1774852595.403761}
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS99704') HTTP/1.1" 204 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for NU98421: 2
2026-03-30 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-30 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925d536b-fe72-535e-ba07-122209d6df04 with scrape type 2
2026-03-30 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 925d536b-fe72-535e-ba07-122209d6df04 with scrape type 2
2026-03-30 06:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 925d536b-fe72-535e-ba07-122209d6df04, identifier: NU98421
2026-03-30 06:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-30 06:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-30 06:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421 to the API
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:57Z',
 'fuel_type': 'diesel',
 'id': '925d536b-fe72-535e-ba07-122209d6df04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU98421',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 188143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2015}
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Saving data for NU98421: {'auction_closing_time': 1774884297.0, 'created_time': 1774644010.916528, 'last_price_update_time': 1774852595.813681}
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU98421') HTTP/1.1" 204 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-30 06:36:35 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-30 06:36:35 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-30 06:36:35 [auto1.be] INFO: Scrape type for SR93497: 2
2026-03-30 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-30 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb44c10-e870-5f23-ba13-d7d9521f4351 with scrape type 2
2026-03-30 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb44c10-e870-5f23-ba13-d7d9521f4351 with scrape type 2
2026-03-30 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb44c10-e870-5f23-ba13-d7d9521f4351, identifier: SR93497
2026-03-30 06:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-30 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-30 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497 to the API
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:46:40Z',
 'fuel_type': 'diesel',
 'id': '5cb44c10-e870-5f23-ba13-d7d9521f4351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR93497',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 213675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Saving data for SR93497: {'auction_closing_time': 1774885600.0, 'created_time': 1773779797.168772, 'last_price_update_time': 1774852596.31226}
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR93497') HTTP/1.1" 204 0
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-30 06:36:36 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Scrape type for YR29884: 2
2026-03-30 06:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-30 06:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41970f1e-7c10-5801-9d46-d71c751dcf72 with scrape type 2
2026-03-30 06:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41970f1e-7c10-5801-9d46-d71c751dcf72 with scrape type 2
2026-03-30 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41970f1e-7c10-5801-9d46-d71c751dcf72, identifier: YR29884
2026-03-30 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-30 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-30 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884 to the API
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:08:15Z',
 'fuel_type': 'diesel',
 'id': '41970f1e-7c10-5801-9d46-d71c751dcf72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR29884',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 217858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-30 06:36:36 [auto1.be] INFO: Saving data for YR29884: {'auction_closing_time': 1774883295.0, 'created_time': 1774557518.029565, 'last_price_update_time': 1774852596.900458}
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YR29884') HTTP/1.1" 204 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for NK28391: 2
2026-03-30 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-30 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with scrape type 2
2026-03-30 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with scrape type 2
2026-03-30 06:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c, identifier: NK28391
2026-03-30 06:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-30 06:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-30 06:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391 to the API
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'diesel',
 'id': 'f79b16c6-f2b0-5b80-94d2-ade444ee2d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK28391',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 144167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Renault Laguna 1.5 dCi Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2014}
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Saving data for NK28391: {'auction_closing_time': 1774885219.0, 'created_time': 1774557526.094866, 'last_price_update_time': 1774852597.378131}
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK28391') HTTP/1.1" 204 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for VZ78935: 2
2026-03-30 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-30 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with scrape type 2
2026-03-30 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with scrape type 2
2026-03-30 06:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb2f53c-6290-5dbe-95bc-2bb7b214bc69, identifier: VZ78935
2026-03-30 06:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-30 06:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-30 06:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935 to the API
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': 'efb2f53c-6290-5dbe-95bc-2bb7b214bc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ78935',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 277915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'automatic',
 'trim': 'clean diesel',
 'year': 2015}
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Saving data for VZ78935: {'auction_closing_time': 1774885702.0, 'created_time': 1774643995.53797, 'last_price_update_time': 1774852597.83058}
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ78935') HTTP/1.1" 204 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-30 06:36:37 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-30 06:36:37 [auto1.be] INFO: Scrape type for BV56621: 2
2026-03-30 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-30 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54af18b5-21b7-5c6d-b43c-996322979c28 with scrape type 2
2026-03-30 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54af18b5-21b7-5c6d-b43c-996322979c28 with scrape type 2
2026-03-30 06:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54af18b5-21b7-5c6d-b43c-996322979c28, identifier: BV56621
2026-03-30 06:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-30 06:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-30 06:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621 to the API
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'gas',
 'id': '54af18b5-21b7-5c6d-b43c-996322979c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV56621',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 147940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Saving data for BV56621: {'auction_closing_time': 1774885373.0, 'created_time': 1774644011.260984, 'last_price_update_time': 1774852598.285235}
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV56621') HTTP/1.1" 204 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-30 06:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:38 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-30 06:36:38 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-30 06:36:38 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-30 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for ZZ47044: 2
2026-03-30 06:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-30 06:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76329f7b-2ec6-53ed-928c-109f9d364699 with scrape type 2
2026-03-30 06:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76329f7b-2ec6-53ed-928c-109f9d364699 with scrape type 2
2026-03-30 06:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76329f7b-2ec6-53ed-928c-109f9d364699, identifier: ZZ47044
2026-03-30 06:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-30 06:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-30 06:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044 to the API
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'diesel',
 'id': '76329f7b-2ec6-53ed-928c-109f9d364699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ47044',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 241719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-03',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2008}
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Saving data for ZZ47044: {'auction_closing_time': 1774883806.0, 'created_time': 1774643963.728874, 'last_price_update_time': 1774852599.358201}
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ47044') HTTP/1.1" 204 0
2026-03-30 06:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-30 06:36:39 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Scrape type for FE56390: 2
2026-03-30 06:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-30 06:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b50d0127-601a-5821-98ae-9af60a6c557f with scrape type 2
2026-03-30 06:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b50d0127-601a-5821-98ae-9af60a6c557f with scrape type 2
2026-03-30 06:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b50d0127-601a-5821-98ae-9af60a6c557f, identifier: FE56390
2026-03-30 06:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-30 06:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-30 06:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390 to the API
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:43Z',
 'fuel_type': 'diesel',
 'id': 'b50d0127-601a-5821-98ae-9af60a6c557f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE56390',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 40092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-30 06:36:39 [auto1.be] INFO: Saving data for FE56390: {'auction_closing_time': 1774885543.0, 'created_time': 1773866677.280469, 'last_price_update_time': 1774852599.972515}
2026-03-30 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE56390') HTTP/1.1" 204 0
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-30 06:36:40 [auto1.be] INFO: Scrape type for UL72077: 2
2026-03-30 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-30 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114e7634-f28a-5234-9918-f2f9b147ffe8 with scrape type 2
2026-03-30 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 114e7634-f28a-5234-9918-f2f9b147ffe8 with scrape type 2
2026-03-30 06:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 114e7634-f28a-5234-9918-f2f9b147ffe8, identifier: UL72077
2026-03-30 06:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-30 06:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-30 06:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077 to the API
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:44:12Z',
 'fuel_type': 'petrol',
 'id': '114e7634-f28a-5234-9918-f2f9b147ffe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL72077',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 50514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-30 06:36:40 [auto1.be] INFO: Saving data for UL72077: {'auction_closing_time': 1774885452.0, 'created_time': 1774557542.208735, 'last_price_update_time': 1774852600.565883}
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL72077') HTTP/1.1" 204 0
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-30 06:36:40 [auto1.be] INFO: Scrape type for VZ08217: 2
2026-03-30 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-30 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with scrape type 2
2026-03-30 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with scrape type 2
2026-03-30 06:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f, identifier: VZ08217
2026-03-30 06:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-30 06:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-30 06:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217 to the API
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'diesel',
 'id': '3637e5af-02b9-5d3e-84f7-3dfaf610a57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ08217',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 117666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-20',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-30 06:36:40 [auto1.be] INFO: Saving data for VZ08217: {'auction_closing_time': 1774885985.0, 'created_time': 1774643839.440556, 'last_price_update_time': 1774852600.966718}
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ08217') HTTP/1.1" 204 0
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-30 06:36:40 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-30 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-30 06:36:41 [auto1.be] INFO: Scrape type for YL00049: 2
2026-03-30 06:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-30 06:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2f0edb-1049-5294-935f-63d616141fcd with scrape type 2
2026-03-30 06:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc2f0edb-1049-5294-935f-63d616141fcd with scrape type 2
2026-03-30 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc2f0edb-1049-5294-935f-63d616141fcd, identifier: YL00049
2026-03-30 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-30 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-30 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049 to the API
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'diesel',
 'id': 'dc2f0edb-1049-5294-935f-63d616141fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL00049',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 55452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-30 06:36:41 [auto1.be] INFO: Saving data for YL00049: {'auction_closing_time': 1774884670.0, 'created_time': 1774643894.520436, 'last_price_update_time': 1774852601.359846}
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL00049') HTTP/1.1" 204 0
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-30 06:36:41 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-30 06:36:41 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-30 06:36:41 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-30 06:36:41 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 06:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:42 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-30 06:36:42 [auto1.be] INFO: Scrape type for KC33551: 2
2026-03-30 06:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-30 06:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea5be3c-34ec-5c73-b35c-a191c18de72f with scrape type 2
2026-03-30 06:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea5be3c-34ec-5c73-b35c-a191c18de72f with scrape type 2
2026-03-30 06:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea5be3c-34ec-5c73-b35c-a191c18de72f, identifier: KC33551
2026-03-30 06:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-30 06:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-30 06:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551 to the API
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:13:00Z',
 'fuel_type': 'diesel',
 'id': '0ea5be3c-34ec-5c73-b35c-a191c18de72f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC33551',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 291273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-30 06:36:42 [auto1.be] INFO: Saving data for KC33551: {'auction_closing_time': 1774883580.0, 'created_time': 1773953365.939709, 'last_price_update_time': 1774852602.814388}
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC33551') HTTP/1.1" 204 0
2026-03-30 06:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-30 06:36:42 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-30 06:36:42 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-30 06:36:42 [auto1.be] INFO: Scrape type for VJ27978: 2
2026-03-30 06:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-30 06:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff84086-90db-5d0d-8aaa-41cb224de801 with scrape type 2
2026-03-30 06:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff84086-90db-5d0d-8aaa-41cb224de801 with scrape type 2
2026-03-30 06:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ff84086-90db-5d0d-8aaa-41cb224de801, identifier: VJ27978
2026-03-30 06:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-30 06:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-30 06:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978 to the API
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:13Z',
 'fuel_type': 'petrol',
 'id': '1ff84086-90db-5d0d-8aaa-41cb224de801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ27978',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 76327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2022}
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-30 06:36:43 [auto1.be] INFO: Saving data for VJ27978: {'auction_closing_time': 1774885033.0, 'created_time': 1774557326.931693, 'last_price_update_time': 1774852603.285611}
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VJ27978') HTTP/1.1" 204 0
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-30 06:36:43 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-30 06:36:43 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-30 06:36:43 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-30 06:36:43 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-30 06:36:43 [auto1.be] INFO: Scrape type for JY53618: 2
2026-03-30 06:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-30 06:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 092b285f-2a02-5153-bb1b-d65a1605d8cd with scrape type 2
2026-03-30 06:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 092b285f-2a02-5153-bb1b-d65a1605d8cd with scrape type 2
2026-03-30 06:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 092b285f-2a02-5153-bb1b-d65a1605d8cd, identifier: JY53618
2026-03-30 06:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-30 06:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-30 06:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618 to the API
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:10:32Z',
 'fuel_type': 'diesel',
 'id': '092b285f-2a02-5153-bb1b-d65a1605d8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY53618',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 114433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Ford Transit 1.8 TDCi Kasten Lang Trend',
 'transmission': 'manual',
 'trim': 'Kasten Lang Trend',
 'year': 2013}
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-30 06:36:43 [auto1.be] INFO: Saving data for JY53618: {'auction_closing_time': 1774883432.0, 'created_time': 1773866710.151487, 'last_price_update_time': 1774852603.876813}
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY53618') HTTP/1.1" 204 0
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-30 06:36:44 [auto1.be] INFO: Scrape type for VB55746: 2
2026-03-30 06:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-30 06:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with scrape type 2
2026-03-30 06:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with scrape type 2
2026-03-30 06:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18, identifier: VB55746
2026-03-30 06:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-30 06:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-30 06:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746 to the API
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:35:57Z',
 'fuel_type': 'petrol',
 'id': '7f52fa47-a3e2-5ce3-ac47-f9f69db83e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB55746',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 123897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-30 06:36:44 [auto1.be] INFO: Saving data for VB55746: {'auction_closing_time': 1774884957.0, 'created_time': 1774643902.035282, 'last_price_update_time': 1774852604.477736}
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB55746') HTTP/1.1" 204 0
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-30 06:36:44 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-30 06:36:44 [auto1.be] INFO: Scrape type for MG12074: 2
2026-03-30 06:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-30 06:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 with scrape type 2
2026-03-30 06:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 with scrape type 2
2026-03-30 06:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 233a848e-6c23-55cb-beeb-a529abb7e4c5, identifier: MG12074
2026-03-30 06:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-30 06:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-30 06:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074 to the API
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:46Z',
 'fuel_type': 'diesel',
 'id': '233a848e-6c23-55cb-beeb-a529abb7e4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG12074',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 181544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-30 06:36:44 [auto1.be] INFO: Saving data for MG12074: {'auction_closing_time': 1774885786.0, 'created_time': 1774643999.891409, 'last_price_update_time': 1774852604.96714}
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG12074') HTTP/1.1" 204 0
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-30 06:36:44 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-30 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-30 06:36:45 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-30 06:36:45 [auto1.be] INFO: Scrape type for SC59712: 2
2026-03-30 06:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-30 06:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 with scrape type 2
2026-03-30 06:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 with scrape type 2
2026-03-30 06:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a06debf-942b-59fe-aa39-cc2aa07606c9, identifier: SC59712
2026-03-30 06:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-30 06:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-30 06:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712 to the API
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:34:56Z',
 'fuel_type': 'diesel',
 'id': '0a06debf-942b-59fe-aa39-cc2aa07606c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC59712',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 98451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-25',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2018}
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-30 06:36:45 [auto1.be] INFO: Saving data for SC59712: {'auction_closing_time': 1774884896.0, 'created_time': 1774643985.486813, 'last_price_update_time': 1774852605.371525}
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC59712') HTTP/1.1" 204 0
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-30 06:36:45 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-30 06:36:45 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-30 06:36:45 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-30 06:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:46 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-30 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-30 06:36:46 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-30 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-30 06:36:46 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-30 06:36:46 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-30 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-30 06:36:46 [auto1.be] INFO: Scrape type for ZX33086: 2
2026-03-30 06:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-30 06:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411cec9e-6db0-5a65-8b95-919189bfb052 with scrape type 2
2026-03-30 06:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411cec9e-6db0-5a65-8b95-919189bfb052 with scrape type 2
2026-03-30 06:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 411cec9e-6db0-5a65-8b95-919189bfb052, identifier: ZX33086
2026-03-30 06:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-30 06:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-30 06:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086 to the API
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:22Z',
 'fuel_type': 'petrol',
 'id': '411cec9e-6db0-5a65-8b95-919189bfb052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX33086',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Saving data for ZX33086: {'auction_closing_time': 1774885102.0, 'created_time': 1774557403.37692, 'last_price_update_time': 1774852607.247501}
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX33086') HTTP/1.1" 204 0
2026-03-30 06:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Scrape type for GS68920: 2
2026-03-30 06:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-30 06:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e83de13-45c4-53fa-9b3c-534652257f0b with scrape type 2
2026-03-30 06:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e83de13-45c4-53fa-9b3c-534652257f0b with scrape type 2
2026-03-30 06:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e83de13-45c4-53fa-9b3c-534652257f0b, identifier: GS68920
2026-03-30 06:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-30 06:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-30 06:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920 to the API
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '0e83de13-45c4-53fa-9b3c-534652257f0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS68920',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 293419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline',
 'transmission': 'manual',
 'trim': 'Maxi Trendline',
 'year': 2014}
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Saving data for GS68920: {'auction_closing_time': 1774885528.0, 'created_time': 1774557442.016866, 'last_price_update_time': 1774852607.738329}
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS68920') HTTP/1.1" 204 0
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-30 06:36:47 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-30 06:36:47 [auto1.be] INFO: Scrape type for XB11874: 2
2026-03-30 06:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-30 06:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with scrape type 2
2026-03-30 06:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with scrape type 2
2026-03-30 06:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99415bc3-21eb-5b1a-940a-2c85acecd4e8, identifier: XB11874
2026-03-30 06:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-30 06:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-30 06:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874 to the API
2026-03-30 06:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:24:02Z',
 'fuel_type': 'diesel',
 'id': '99415bc3-21eb-5b1a-940a-2c85acecd4e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB11874',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 59945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-10',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-30 06:36:48 [auto1.be] INFO: Saving data for XB11874: {'auction_closing_time': 1774884242.0, 'created_time': 1774643956.570489, 'last_price_update_time': 1774852608.153322}
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB11874') HTTP/1.1" 204 0
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-30 06:36:48 [auto1.be] INFO: Scrape type for MX90898: 2
2026-03-30 06:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-30 06:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e2cdb9-51d7-5461-9e3c-886975dd210d with scrape type 2
2026-03-30 06:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e2cdb9-51d7-5461-9e3c-886975dd210d with scrape type 2
2026-03-30 06:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17e2cdb9-51d7-5461-9e3c-886975dd210d, identifier: MX90898
2026-03-30 06:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-30 06:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-30 06:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898 to the API
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:55:59Z',
 'fuel_type': 'petrol',
 'id': '17e2cdb9-51d7-5461-9e3c-886975dd210d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX90898',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 33245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-22',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Plus',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2024}
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-30 06:36:48 [auto1.be] INFO: Saving data for MX90898: {'auction_closing_time': 1774886159.0, 'created_time': 1774557501.045591, 'last_price_update_time': 1774852608.619099}
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX90898') HTTP/1.1" 204 0
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-30 06:36:48 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-30 06:36:48 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-30 06:36:48 [auto1.be] INFO: Scrape type for LF23330: 2
2026-03-30 06:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-30 06:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 789a9828-d901-5a3c-bfde-13ea36225351 with scrape type 2
2026-03-30 06:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 789a9828-d901-5a3c-bfde-13ea36225351 with scrape type 2
2026-03-30 06:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 789a9828-d901-5a3c-bfde-13ea36225351, identifier: LF23330
2026-03-30 06:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-30 06:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-30 06:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330 to the API
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:38Z',
 'fuel_type': 'diesel',
 'id': '789a9828-d901-5a3c-bfde-13ea36225351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF23330',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 220661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-08',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDIe Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Saving data for LF23330: {'auction_closing_time': 1774884038.0, 'created_time': 1774557332.108156, 'last_price_update_time': 1774852609.0211}
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF23330') HTTP/1.1" 204 0
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Scrape type for AB25804: 2
2026-03-30 06:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-30 06:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1645fa-fb66-50ea-8f1e-283d5e7d561b with scrape type 2
2026-03-30 06:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1645fa-fb66-50ea-8f1e-283d5e7d561b with scrape type 2
2026-03-30 06:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd1645fa-fb66-50ea-8f1e-283d5e7d561b, identifier: AB25804
2026-03-30 06:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-30 06:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-30 06:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804 to the API
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:38:48Z',
 'fuel_type': 'petrol',
 'id': 'bd1645fa-fb66-50ea-8f1e-283d5e7d561b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB25804',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-14',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2025}
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Saving data for AB25804: {'auction_closing_time': 1774885128.0, 'created_time': 1774557515.802979, 'last_price_update_time': 1774852609.476188}
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB25804') HTTP/1.1" 204 0
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Scrape type for AD33980: 2
2026-03-30 06:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-30 06:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bdc7506-262d-593d-b4d9-706bf3948b06 with scrape type 2
2026-03-30 06:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bdc7506-262d-593d-b4d9-706bf3948b06 with scrape type 2
2026-03-30 06:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bdc7506-262d-593d-b4d9-706bf3948b06, identifier: AD33980
2026-03-30 06:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-30 06:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-30 06:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980 to the API
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:34:10Z',
 'fuel_type': 'diesel',
 'id': '2bdc7506-262d-593d-b4d9-706bf3948b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD33980',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 154183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Saving data for AD33980: {'auction_closing_time': 1774884850.0, 'created_time': 1774557578.647518, 'last_price_update_time': 1774852609.946952}
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD33980') HTTP/1.1" 204 0
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-30 06:36:49 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-30 06:36:49 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-30 06:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:50 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-30 06:36:50 [auto1.be] INFO: Scrape type for JC93215: 2
2026-03-30 06:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-30 06:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 with scrape type 2
2026-03-30 06:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 with scrape type 2
2026-03-30 06:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3eebaf58-74f5-5452-a391-ffcdcee41b69, identifier: JC93215
2026-03-30 06:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-30 06:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-30 06:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215 to the API
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:17:57Z',
 'fuel_type': 'diesel',
 'id': '3eebaf58-74f5-5452-a391-ffcdcee41b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC93215',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 341195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-07',
 'seller_name': None,
 'title': 'Audi A8 4.0 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2004}
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-30 06:36:50 [auto1.be] INFO: Saving data for JC93215: {'auction_closing_time': 1774883877.0, 'created_time': 1774643938.979034, 'last_price_update_time': 1774852610.467615}
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC93215') HTTP/1.1" 204 0
2026-03-30 06:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-30 06:36:50 [auto1.be] INFO: Scrape type for TD70367: 2
2026-03-30 06:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-30 06:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497437b8-5a84-5bda-a08c-1e6314a053c7 with scrape type 2
2026-03-30 06:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497437b8-5a84-5bda-a08c-1e6314a053c7 with scrape type 2
2026-03-30 06:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 497437b8-5a84-5bda-a08c-1e6314a053c7, identifier: TD70367
2026-03-30 06:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-30 06:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-30 06:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367 to the API
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'diesel',
 'id': '497437b8-5a84-5bda-a08c-1e6314a053c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD70367',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 192011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-12',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-30 06:36:50 [auto1.be] INFO: Saving data for TD70367: {'auction_closing_time': 1774884352.0, 'created_time': 1773920140.021664, 'last_price_update_time': 1774852610.852482}
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD70367') HTTP/1.1" 204 0
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-30 06:36:50 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-30 06:36:50 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-30 06:36:50 [auto1.be] INFO: Scrape type for RX86056: 2
2026-03-30 06:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-30 06:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with scrape type 2
2026-03-30 06:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with scrape type 2
2026-03-30 06:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0, identifier: RX86056
2026-03-30 06:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-30 06:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-30 06:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056 to the API
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:20Z',
 'fuel_type': 'petrol',
 'id': 'd55adb9d-1855-5e89-b8b1-4016a3f0f3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX86056',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 205833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2021}
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-30 06:36:51 [auto1.be] INFO: Saving data for RX86056: {'auction_closing_time': 1774883720.0, 'created_time': 1774557579.795658, 'last_price_update_time': 1774852611.332021}
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX86056') HTTP/1.1" 204 0
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-30 06:36:51 [auto1.be] INFO: Scrape type for LP97900: 2
2026-03-30 06:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-30 06:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24fb04d-1ea3-5a18-8032-cb7db71dff9a with scrape type 2
2026-03-30 06:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24fb04d-1ea3-5a18-8032-cb7db71dff9a with scrape type 2
2026-03-30 06:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c24fb04d-1ea3-5a18-8032-cb7db71dff9a, identifier: LP97900
2026-03-30 06:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-30 06:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-30 06:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900 to the API
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:27:35Z',
 'fuel_type': 'petrol',
 'id': 'c24fb04d-1ea3-5a18-8032-cb7db71dff9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP97900',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 156187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-30 06:36:51 [auto1.be] INFO: Saving data for LP97900: {'auction_closing_time': 1774884455.0, 'created_time': 1774557403.015356, 'last_price_update_time': 1774852611.714707}
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP97900') HTTP/1.1" 204 0
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-30 06:36:51 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-30 06:36:51 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-30 06:36:51 [auto1.be] INFO: Scrape type for RH32729: 2
2026-03-30 06:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-30 06:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with scrape type 2
2026-03-30 06:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with scrape type 2
2026-03-30 06:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772, identifier: RH32729
2026-03-30 06:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-30 06:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-30 06:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729 to the API
2026-03-30 06:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:26:48Z',
 'fuel_type': 'petrol',
 'id': '5cb30bfc-ec38-501b-9be5-bbf1a07fb772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH32729',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 107330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Jaguar XE 20t R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2018}
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-30 06:36:52 [auto1.be] INFO: Saving data for RH32729: {'auction_closing_time': 1774884408.0, 'created_time': 1774557413.38859, 'last_price_update_time': 1774852612.134668}
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH32729') HTTP/1.1" 204 0
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-30 06:36:52 [auto1.be] INFO: Scrape type for LT47332: 2
2026-03-30 06:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-30 06:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2d9e26-972c-549d-b944-52de0d5b2414 with scrape type 2
2026-03-30 06:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd2d9e26-972c-549d-b944-52de0d5b2414 with scrape type 2
2026-03-30 06:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd2d9e26-972c-549d-b944-52de0d5b2414, identifier: LT47332
2026-03-30 06:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-30 06:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-30 06:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332 to the API
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:44:15Z',
 'fuel_type': 'petrol',
 'id': 'fd2d9e26-972c-549d-b944-52de0d5b2414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT47332',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 176805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-02',
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-30 06:36:52 [auto1.be] INFO: Saving data for LT47332: {'auction_closing_time': 1774885455.0, 'created_time': 1774557430.26255, 'last_price_update_time': 1774852612.594185}
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT47332') HTTP/1.1" 204 0
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-30 06:36:52 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-30 06:36:52 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-30 06:36:52 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-30 06:36:52 [auto1.be] INFO: Scrape type for UA44051: 2
2026-03-30 06:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-30 06:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with scrape type 2
2026-03-30 06:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with scrape type 2
2026-03-30 06:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e, identifier: UA44051
2026-03-30 06:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-30 06:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-30 06:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051 to the API
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'diesel',
 'id': '76a5cf51-2799-5d31-9ca8-53fa6bc4766e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44051',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 162200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 300 K LKW',
 'transmission': 'manual',
 'trim': 'FT 300 K LKW',
 'year': 2008}
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Saving data for UA44051: {'auction_closing_time': 1774885991.0, 'created_time': 1774254987.486264, 'last_price_update_time': 1774852613.057546}
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA44051') HTTP/1.1" 204 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for AT20959: 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for RS45224: 2
2026-03-30 06:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-30 06:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with scrape type 2
2026-03-30 06:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with scrape type 2
2026-03-30 06:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0, identifier: RS45224
2026-03-30 06:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-30 06:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-30 06:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224 to the API
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:49Z',
 'fuel_type': 'diesel',
 'id': 'bcf8a864-bc50-59dc-a82d-e29ed5f9cef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS45224',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 155214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2015}
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Saving data for RS45224: {'auction_closing_time': 1774886029.0, 'created_time': 1774557400.059398, 'last_price_update_time': 1774852613.588414}
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS45224') HTTP/1.1" 204 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-30 06:36:53 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-30 06:36:53 [auto1.be] INFO: Scrape type for XM10489: 2
2026-03-30 06:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-30 06:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f440364-48c8-56e5-b5b4-01812722451f with scrape type 2
2026-03-30 06:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f440364-48c8-56e5-b5b4-01812722451f with scrape type 2
2026-03-30 06:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f440364-48c8-56e5-b5b4-01812722451f, identifier: XM10489
2026-03-30 06:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-30 06:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-30 06:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489 to the API
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:05:49Z',
 'fuel_type': 'diesel',
 'id': '0f440364-48c8-56e5-b5b4-01812722451f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM10489',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 160771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-04',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi 15th',
 'transmission': 'manual',
 'trim': '15th',
 'year': 2011}
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Saving data for XM10489: {'auction_closing_time': 1774883149.0, 'created_time': 1774557536.624046, 'last_price_update_time': 1774852614.086493}
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM10489') HTTP/1.1" 204 0
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-30 06:36:54 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for MZ51776: 2
2026-03-30 06:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-30 06:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6ac897-8ff7-5823-8019-bd26b347b4a1 with scrape type 2
2026-03-30 06:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe6ac897-8ff7-5823-8019-bd26b347b4a1 with scrape type 2
2026-03-30 06:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fe6ac897-8ff7-5823-8019-bd26b347b4a1, identifier: MZ51776
2026-03-30 06:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-30 06:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-30 06:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776 to the API
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:59:45Z',
 'fuel_type': 'diesel',
 'id': 'fe6ac897-8ff7-5823-8019-bd26b347b4a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ51776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 211489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-06',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Saving data for MZ51776: {'auction_closing_time': 1774886385.0, 'created_time': 1773834430.534744, 'last_price_update_time': 1774852614.501253}
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ51776') HTTP/1.1" 204 0
2026-03-30 06:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for HU58936: 2
2026-03-30 06:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-30 06:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with scrape type 2
2026-03-30 06:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with scrape type 2
2026-03-30 06:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c7a7961-d7b1-5951-a8eb-7c1d22350728, identifier: HU58936
2026-03-30 06:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-30 06:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-30 06:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936 to the API
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:04:40Z',
 'fuel_type': 'diesel',
 'id': '9c7a7961-d7b1-5951-a8eb-7c1d22350728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU58936',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 59840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2014}
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Saving data for HU58936: {'auction_closing_time': 1774883080.0, 'created_time': 1774644009.093823, 'last_price_update_time': 1774852614.895893}
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU58936') HTTP/1.1" 204 0
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-30 06:36:54 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-30 06:36:54 [auto1.be] INFO: Scrape type for KG53590: 2
2026-03-30 06:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-30 06:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00394349-364e-5ec8-99db-b307e0845906 with scrape type 2
2026-03-30 06:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00394349-364e-5ec8-99db-b307e0845906 with scrape type 2
2026-03-30 06:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00394349-364e-5ec8-99db-b307e0845906, identifier: KG53590
2026-03-30 06:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-30 06:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-30 06:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590 to the API
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'petrol',
 'id': '00394349-364e-5ec8-99db-b307e0845906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG53590',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 79099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2014}
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-30 06:36:55 [auto1.be] INFO: Saving data for KG53590: {'auction_closing_time': 1774885311.0, 'created_time': 1773834443.225994, 'last_price_update_time': 1774852615.372452}
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG53590') HTTP/1.1" 204 0
2026-03-30 06:36:55 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-30 06:36:55 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-30 06:36:55 [auto1.be] INFO: Scrape type for ZX32272: 2
2026-03-30 06:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-30 06:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with scrape type 2
2026-03-30 06:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with scrape type 2
2026-03-30 06:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3, identifier: ZX32272
2026-03-30 06:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-30 06:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-30 06:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272 to the API
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:14:10Z',
 'fuel_type': 'diesel',
 'id': '9c4ce64c-ca92-5a37-9b73-bc3a62b723e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX32272',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 163844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-30 06:36:55 [auto1.be] INFO: Saving data for ZX32272: {'auction_closing_time': 1774883650.0, 'created_time': 1773866672.228361, 'last_price_update_time': 1774852615.885423}
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX32272') HTTP/1.1" 204 0
2026-03-30 06:36:55 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-30 06:36:55 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-30 06:36:55 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-30 06:36:55 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-30 06:36:55 [auto1.be] INFO: Scrape type for NC57966: 2
2026-03-30 06:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-30 06:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a06727b-0917-5c59-8ec7-31b454997a54 with scrape type 2
2026-03-30 06:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a06727b-0917-5c59-8ec7-31b454997a54 with scrape type 2
2026-03-30 06:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a06727b-0917-5c59-8ec7-31b454997a54, identifier: NC57966
2026-03-30 06:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-30 06:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-30 06:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966 to the API
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:30:23Z',
 'fuel_type': 'petrol',
 'id': '4a06727b-0917-5c59-8ec7-31b454997a54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC57966',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Saving data for NC57966: {'auction_closing_time': 1774884623.0, 'created_time': 1774557446.262756, 'last_price_update_time': 1774852616.271672}
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC57966') HTTP/1.1" 204 0
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Scrape type for VA32651: 2
2026-03-30 06:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-30 06:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 with scrape type 2
2026-03-30 06:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 with scrape type 2
2026-03-30 06:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f9f557a-eaef-5d49-8a8c-25c71a222914, identifier: VA32651
2026-03-30 06:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-30 06:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-30 06:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651 to the API
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'petrol',
 'id': '9f9f557a-eaef-5d49-8a8c-25c71a222914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA32651',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 202806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2015}
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Saving data for VA32651: {'auction_closing_time': 1774885291.0, 'created_time': 1774643958.862555, 'last_price_update_time': 1774852616.731159}
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA32651') HTTP/1.1" 204 0
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-30 06:36:56 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-30 06:36:56 [auto1.be] INFO: Scrape type for MZ96160: 2
2026-03-30 06:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-30 06:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with scrape type 2
2026-03-30 06:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with scrape type 2
2026-03-30 06:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f, identifier: MZ96160
2026-03-30 06:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-30 06:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-30 06:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160 to the API
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:46:00Z',
 'fuel_type': 'hybrid',
 'id': 'df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ96160',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 23940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-03',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-30 06:36:57 [auto1.be] INFO: Saving data for MZ96160: {'auction_closing_time': 1774885560.0, 'created_time': 1774557552.121896, 'last_price_update_time': 1774852617.240016}
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ96160') HTTP/1.1" 204 0
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-30 06:36:57 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-30 06:36:57 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-30 06:36:57 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-30 06:36:57 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-30 06:36:57 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-30 06:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:36:58 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1289 | hits on page: 40
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-30 06:36:58 [auto1.be] INFO: Scrape type for BY25509: 2
2026-03-30 06:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-30 06:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c87b4f-87da-5497-9e21-528da080e9ee with scrape type 2
2026-03-30 06:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c87b4f-87da-5497-9e21-528da080e9ee with scrape type 2
2026-03-30 06:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16c87b4f-87da-5497-9e21-528da080e9ee, identifier: BY25509
2026-03-30 06:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-30 06:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-30 06:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509 to the API
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:23:36Z',
 'fuel_type': 'hybrid',
 'id': '16c87b4f-87da-5497-9e21-528da080e9ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY25509',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 204135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300de T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2020}
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-30 06:36:58 [auto1.be] INFO: Saving data for BY25509: {'auction_closing_time': 1774884216.0, 'created_time': 1774557572.117998, 'last_price_update_time': 1774852618.683341}
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY25509') HTTP/1.1" 204 0
2026-03-30 06:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-30 06:36:58 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-30 06:36:58 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-30 06:36:58 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-30 06:36:58 [auto1.be] INFO: Scrape type for FZ81347: 2
2026-03-30 06:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-30 06:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d86124-31f4-5341-8e00-dd7766516c02 with scrape type 2
2026-03-30 06:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d86124-31f4-5341-8e00-dd7766516c02 with scrape type 2
2026-03-30 06:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5d86124-31f4-5341-8e00-dd7766516c02, identifier: FZ81347
2026-03-30 06:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-30 06:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-30 06:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347 to the API
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:35:08Z',
 'fuel_type': 'petrol',
 'id': 'e5d86124-31f4-5341-8e00-dd7766516c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ81347',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 197758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2018}
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-30 06:36:59 [auto1.be] INFO: Saving data for FZ81347: {'auction_closing_time': 1774884908.0, 'created_time': 1774557442.29652, 'last_price_update_time': 1774852619.222981}
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FZ81347') HTTP/1.1" 204 0
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-30 06:36:59 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-30 06:36:59 [auto1.be] INFO: Scrape type for FR50529: 2
2026-03-30 06:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-30 06:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3ee22-69db-552c-8395-dc8bade66c5b with scrape type 2
2026-03-30 06:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b3ee22-69db-552c-8395-dc8bade66c5b with scrape type 2
2026-03-30 06:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8b3ee22-69db-552c-8395-dc8bade66c5b, identifier: FR50529
2026-03-30 06:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-30 06:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-30 06:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529 to the API
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:25:46Z',
 'fuel_type': 'diesel',
 'id': 'd8b3ee22-69db-552c-8395-dc8bade66c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR50529',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 154582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2020}
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-30 06:36:59 [auto1.be] INFO: Saving data for FR50529: {'auction_closing_time': 1774884346.0, 'created_time': 1774643962.48001, 'last_price_update_time': 1774852619.708626}
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR50529') HTTP/1.1" 204 0
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-30 06:36:59 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-30 06:36:59 [auto1.be] INFO: Scrape type for PY41942: 2
2026-03-30 06:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-30 06:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898f5281-625c-5310-aa5c-5592895a4d7a with scrape type 2
2026-03-30 06:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898f5281-625c-5310-aa5c-5592895a4d7a with scrape type 2
2026-03-30 06:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 898f5281-625c-5310-aa5c-5592895a4d7a, identifier: PY41942
2026-03-30 06:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-30 06:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-30 06:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942 to the API
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:27:41Z',
 'fuel_type': 'petrol',
 'id': '898f5281-625c-5310-aa5c-5592895a4d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY41942',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 92494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-08',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-30 06:37:00 [auto1.be] INFO: Saving data for PY41942: {'auction_closing_time': 1774884461.0, 'created_time': 1774557438.170411, 'last_price_update_time': 1774852620.117683}
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY41942') HTTP/1.1" 204 0
2026-03-30 06:37:00 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-30 06:37:00 [auto1.be] INFO: Scrape type for TP16646: 2
2026-03-30 06:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-30 06:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19e2218-b800-5812-afe4-a97b7adc0024 with scrape type 2
2026-03-30 06:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19e2218-b800-5812-afe4-a97b7adc0024 with scrape type 2
2026-03-30 06:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b19e2218-b800-5812-afe4-a97b7adc0024, identifier: TP16646
2026-03-30 06:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-30 06:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-30 06:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646 to the API
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:26:22Z',
 'fuel_type': 'petrol',
 'id': 'b19e2218-b800-5812-afe4-a97b7adc0024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP16646',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 127886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-30 06:37:00 [auto1.be] INFO: Saving data for TP16646: {'auction_closing_time': 1774884382.0, 'created_time': 1773301759.237631, 'last_price_update_time': 1774852620.505119}
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP16646') HTTP/1.1" 204 0
2026-03-30 06:37:00 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-30 06:37:00 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-30 06:37:00 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-30 06:37:00 [auto1.be] INFO: Scrape type for RU48742: 2
2026-03-30 06:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-30 06:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df166cc3-cd8a-5d39-8640-02d6c5ff48ea with scrape type 2
2026-03-30 06:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df166cc3-cd8a-5d39-8640-02d6c5ff48ea with scrape type 2
2026-03-30 06:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df166cc3-cd8a-5d39-8640-02d6c5ff48ea, identifier: RU48742
2026-03-30 06:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-30 06:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-30 06:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742 to the API
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:35:09Z',
 'fuel_type': 'diesel',
 'id': 'df166cc3-cd8a-5d39-8640-02d6c5ff48ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU48742',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 108378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2020}
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-30 06:37:00 [auto1.be] INFO: Saving data for RU48742: {'auction_closing_time': 1774884909.0, 'created_time': 1773131807.255326, 'last_price_update_time': 1774852620.925783}
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU48742') HTTP/1.1" 204 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for DK63787: 2
2026-03-30 06:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-30 06:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with scrape type 2
2026-03-30 06:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with scrape type 2
2026-03-30 06:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f638d8af-4889-5e8d-9674-aa20a8d4f5a8, identifier: DK63787
2026-03-30 06:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-30 06:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-30 06:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787 to the API
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:23:33Z',
 'fuel_type': 'diesel',
 'id': 'f638d8af-4889-5e8d-9674-aa20a8d4f5a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK63787',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 85511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Active',
 'transmission': 'manual',
 'trim': 'Multijet Active',
 'year': 2010}
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Saving data for DK63787: {'auction_closing_time': 1774884213.0, 'created_time': 1774557489.451068, 'last_price_update_time': 1774852621.390807}
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK63787') HTTP/1.1" 204 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for HU17820: 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for NV75936: 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for AW25378: 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for LS82290: 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-30 06:37:01 [auto1.be] INFO: Scrape type for CM51817: 0
2026-03-30 06:37:01 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-30 06:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:02 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1289 | hits on page: 40
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-30 06:37:02 [auto1.be] INFO: Scrape type for RD23593: 2
2026-03-30 06:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593
2026-03-30 06:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e with scrape type 2
2026-03-30 06:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e with scrape type 2
2026-03-30 06:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25613ed9-f9eb-56cd-9ec2-511ffca8132e, identifier: RD23593
2026-03-30 06:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593
2026-03-30 06:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593
2026-03-30 06:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593 to the API
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:53:16Z',
 'fuel_type': 'diesel',
 'id': '25613ed9-f9eb-56cd-9ec2-511ffca8132e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD23593',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 170232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 Escapade',
 'transmission': 'manual',
 'trim': 'L2H1 Escapade',
 'year': 2021}
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-30 06:37:02 [auto1.be] INFO: Saving data for RD23593: {'auction_closing_time': 1774885996.0, 'created_time': 1774730301.11669, 'last_price_update_time': 1774852622.466882}
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD23593') HTTP/1.1" 204 0
2026-03-30 06:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-30 06:37:02 [auto1.be] INFO: Scrape type for GD95033: 2
2026-03-30 06:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033
2026-03-30 06:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb5e8535-2625-510e-88b3-3698b3a44caa with scrape type 2
2026-03-30 06:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb5e8535-2625-510e-88b3-3698b3a44caa with scrape type 2
2026-03-30 06:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb5e8535-2625-510e-88b3-3698b3a44caa, identifier: GD95033
2026-03-30 06:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033
2026-03-30 06:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033
2026-03-30 06:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033 to the API
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:55:23Z',
 'fuel_type': 'diesel',
 'id': 'cb5e8535-2625-510e-88b3-3698b3a44caa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD95033',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 161347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Iveco Daily 3.0 Diesel GKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'GKa 35 S V Radstand 3520 L',
 'year': 2019}
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-30 06:37:02 [auto1.be] INFO: Saving data for GD95033: {'auction_closing_time': 1774886123.0, 'created_time': 1774039029.543389, 'last_price_update_time': 1774852622.969917}
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GD95033') HTTP/1.1" 204 0
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-30 06:37:02 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-30 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-30 06:37:03 [auto1.be] INFO: Scrape type for LG99308: 2
2026-03-30 06:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308
2026-03-30 06:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c616886c-40cd-54e2-876c-ca245eae83f0 with scrape type 2
2026-03-30 06:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c616886c-40cd-54e2-876c-ca245eae83f0 with scrape type 2
2026-03-30 06:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c616886c-40cd-54e2-876c-ca245eae83f0, identifier: LG99308
2026-03-30 06:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308
2026-03-30 06:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308
2026-03-30 06:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308 to the API
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:26Z',
 'fuel_type': 'diesel',
 'id': 'c616886c-40cd-54e2-876c-ca245eae83f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG99308',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 90061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-17',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super 2WD',
 'transmission': 'automatic',
 'trim': 'Super 2WD',
 'year': 2017}
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-30 06:37:03 [auto1.be] INFO: Saving data for LG99308: {'auction_closing_time': 1774885526.0, 'created_time': 1774730303.931068, 'last_price_update_time': 1774852623.364854}
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG99308') HTTP/1.1" 204 0
2026-03-30 06:37:03 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-30 06:37:03 [auto1.be] INFO: Scrape type for KW17867: 2
2026-03-30 06:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867
2026-03-30 06:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b82520-6582-5f7a-9216-1dec75494356 with scrape type 2
2026-03-30 06:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b82520-6582-5f7a-9216-1dec75494356 with scrape type 2
2026-03-30 06:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94b82520-6582-5f7a-9216-1dec75494356, identifier: KW17867
2026-03-30 06:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867
2026-03-30 06:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867
2026-03-30 06:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867 to the API
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:39:25Z',
 'fuel_type': 'petrol',
 'id': '94b82520-6582-5f7a-9216-1dec75494356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW17867',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 138871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2019}
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-30 06:37:03 [auto1.be] INFO: Saving data for KW17867: {'auction_closing_time': 1774885165.0, 'created_time': 1774730314.966894, 'last_price_update_time': 1774852623.745255}
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW17867') HTTP/1.1" 204 0
2026-03-30 06:37:03 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-30 06:37:03 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-30 06:37:03 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-30 06:37:03 [auto1.be] INFO: Scrape type for HS15781: 2
2026-03-30 06:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781
2026-03-30 06:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b2552a-3753-5935-b5aa-78022f00079d with scrape type 2
2026-03-30 06:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79b2552a-3753-5935-b5aa-78022f00079d with scrape type 2
2026-03-30 06:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79b2552a-3753-5935-b5aa-78022f00079d, identifier: HS15781
2026-03-30 06:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781
2026-03-30 06:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781
2026-03-30 06:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781 to the API
2026-03-30 06:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:33:40Z',
 'fuel_type': 'diesel',
 'id': '79b2552a-3753-5935-b5aa-78022f00079d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS15781',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 126668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-30 06:37:04 [auto1.be] INFO: Saving data for HS15781: {'auction_closing_time': 1774884820.0, 'created_time': 1774730300.533669, 'last_price_update_time': 1774852624.141151}
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS15781') HTTP/1.1" 204 0
2026-03-30 06:37:04 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-30 06:37:04 [auto1.be] INFO: Scrape type for HT80629: 2
2026-03-30 06:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629
2026-03-30 06:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with scrape type 2
2026-03-30 06:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with scrape type 2
2026-03-30 06:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7, identifier: HT80629
2026-03-30 06:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629
2026-03-30 06:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629
2026-03-30 06:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629 to the API
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:50:42Z',
 'fuel_type': 'petrol',
 'id': '8fba3b0a-d9a3-5ddf-9405-a33004af36f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT80629',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 53200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2014}
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-30 06:37:04 [auto1.be] INFO: Saving data for HT80629: {'auction_closing_time': 1774885842.0, 'created_time': 1774730310.452009, 'last_price_update_time': 1774852624.534961}
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT80629') HTTP/1.1" 204 0
2026-03-30 06:37:04 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-30 06:37:04 [auto1.be] INFO: Scrape type for FT23017: 2
2026-03-30 06:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017
2026-03-30 06:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01cd576d-046c-5518-ad4a-9db2edde1ad5 with scrape type 2
2026-03-30 06:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01cd576d-046c-5518-ad4a-9db2edde1ad5 with scrape type 2
2026-03-30 06:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01cd576d-046c-5518-ad4a-9db2edde1ad5, identifier: FT23017
2026-03-30 06:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017
2026-03-30 06:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017
2026-03-30 06:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017 to the API
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:35Z',
 'fuel_type': 'diesel',
 'id': '01cd576d-046c-5518-ad4a-9db2edde1ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT23017',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 173043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-15',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi 60 Jahre 4x4',
 'transmission': 'manual',
 'trim': '60 Jahre 4x4',
 'year': 2012}
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-30 06:37:04 [auto1.be] INFO: Saving data for FT23017: {'auction_closing_time': 1774884335.0, 'created_time': 1774730252.114162, 'last_price_update_time': 1774852624.936573}
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT23017') HTTP/1.1" 204 0
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-30 06:37:05 [auto1.be] INFO: Scrape type for MY75694: 2
2026-03-30 06:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694
2026-03-30 06:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96362a5-b7df-5360-9b83-8295d9f087d0 with scrape type 2
2026-03-30 06:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96362a5-b7df-5360-9b83-8295d9f087d0 with scrape type 2
2026-03-30 06:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e96362a5-b7df-5360-9b83-8295d9f087d0, identifier: MY75694
2026-03-30 06:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694
2026-03-30 06:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694
2026-03-30 06:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694 to the API
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:50Z',
 'fuel_type': 'diesel',
 'id': 'e96362a5-b7df-5360-9b83-8295d9f087d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY75694',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 234603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-06',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-30 06:37:05 [auto1.be] INFO: Saving data for MY75694: {'auction_closing_time': 1774884770.0, 'created_time': 1774730310.106781, 'last_price_update_time': 1774852625.404078}
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MY75694') HTTP/1.1" 204 0
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-30 06:37:05 [auto1.be] INFO: Scrape type for LH19076: 2
2026-03-30 06:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076
2026-03-30 06:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with scrape type 2
2026-03-30 06:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with scrape type 2
2026-03-30 06:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c, identifier: LH19076
2026-03-30 06:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076
2026-03-30 06:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076
2026-03-30 06:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076 to the API
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:04:09Z',
 'fuel_type': 'petrol',
 'id': '3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH19076',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 131198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-02',
 'seller_name': None,
 'title': 'Renault Scenic 2.0 Exception',
 'transmission': 'automatic',
 'trim': 'Exception',
 'year': 2007}
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-30 06:37:05 [auto1.be] INFO: Saving data for LH19076: {'auction_closing_time': 1774883049.0, 'created_time': 1773384094.854703, 'last_price_update_time': 1774852625.784256}
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH19076') HTTP/1.1" 204 0
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-30 06:37:05 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-30 06:37:05 [auto1.be] INFO: Scrape type for TF49476: 2
2026-03-30 06:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476
2026-03-30 06:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22baa273-e520-5500-a7b4-d64af948f4c5 with scrape type 2
2026-03-30 06:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22baa273-e520-5500-a7b4-d64af948f4c5 with scrape type 2
2026-03-30 06:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22baa273-e520-5500-a7b4-d64af948f4c5, identifier: TF49476
2026-03-30 06:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476
2026-03-30 06:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476
2026-03-30 06:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476 to the API
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:52:21Z',
 'fuel_type': 'petrol',
 'id': '22baa273-e520-5500-a7b4-d64af948f4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF49476',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 157587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-06',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-30 06:37:06 [auto1.be] INFO: Saving data for TF49476: {'auction_closing_time': 1774885941.0, 'created_time': 1774730314.605331, 'last_price_update_time': 1774852626.165171}
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF49476') HTTP/1.1" 204 0
2026-03-30 06:37:06 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-30 06:37:06 [auto1.be] INFO: Scrape type for FT86060: 2
2026-03-30 06:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060
2026-03-30 06:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with scrape type 2
2026-03-30 06:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with scrape type 2
2026-03-30 06:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32, identifier: FT86060
2026-03-30 06:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060
2026-03-30 06:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060
2026-03-30 06:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060 to the API
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:48:34Z',
 'fuel_type': 'diesel',
 'id': 'a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT86060',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 87476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-30 06:37:06 [auto1.be] INFO: Saving data for FT86060: {'auction_closing_time': 1774885714.0, 'created_time': 1774730282.264206, 'last_price_update_time': 1774852626.534741}
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT86060') HTTP/1.1" 204 0
2026-03-30 06:37:06 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1289 | hits on page: 40
2026-03-30 06:37:06 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-30 06:37:06 [auto1.be] INFO: Scrape type for JT63704: 2
2026-03-30 06:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704
2026-03-30 06:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with scrape type 2
2026-03-30 06:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with scrape type 2
2026-03-30 06:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b, identifier: JT63704
2026-03-30 06:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704
2026-03-30 06:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704
2026-03-30 06:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704 to the API
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'petrol',
 'id': '6a9fcc85-b0a3-5ce0-a531-54171e2ed35b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT63704',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 166950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2017}
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-30 06:37:06 [auto1.be] INFO: Saving data for JT63704: {'auction_closing_time': 1774884614.0, 'created_time': 1774730297.885569, 'last_price_update_time': 1774852626.933997}
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT63704') HTTP/1.1" 204 0
2026-03-30 06:37:06 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-30 06:37:06 [auto1.be] INFO: Scrape type for JC37428: 2
2026-03-30 06:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428
2026-03-30 06:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11094b10-aa66-5d7c-9047-d570a681a7b4 with scrape type 2
2026-03-30 06:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11094b10-aa66-5d7c-9047-d570a681a7b4 with scrape type 2
2026-03-30 06:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11094b10-aa66-5d7c-9047-d570a681a7b4, identifier: JC37428
2026-03-30 06:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-30 06:37:07 [auto1.be] INFO: Scrape type for SX16585: 2
2026-03-30 06:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585
2026-03-30 06:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with scrape type 2
2026-03-30 06:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with scrape type 2
2026-03-30 06:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11b1a499-c6f6-59c7-9938-fb93fcad50f7, identifier: SX16585
2026-03-30 06:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428
2026-03-30 06:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428
2026-03-30 06:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428 to the API
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:53Z',
 'fuel_type': 'diesel',
 'id': '11094b10-aa66-5d7c-9047-d570a681a7b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC37428',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 287390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-21',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Tomtom Edition',
 'transmission': 'manual',
 'trim': 'Tomtom Edition',
 'year': 2010}
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-30 06:37:07 [auto1.be] INFO: Saving data for JC37428: {'auction_closing_time': 1774883753.0, 'created_time': 1774039014.735276, 'last_price_update_time': 1774852627.450432}
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC37428') HTTP/1.1" 204 0
2026-03-30 06:37:07 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 14 pages/min), scraped 176 items (at 114 items/min)
2026-03-30 06:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 06:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585
2026-03-30 06:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585
2026-03-30 06:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585 to the API
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:39:59Z',
 'fuel_type': 'diesel',
 'id': '11b1a499-c6f6-59c7-9938-fb93fcad50f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX16585',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 117908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 d Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-30 06:37:07 [auto1.be] INFO: Saving data for SX16585: {'auction_closing_time': 1774885199.0, 'created_time': 1774730308.004266, 'last_price_update_time': 1774852627.818454}
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX16585') HTTP/1.1" 204 0
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-30 06:37:07 [auto1.be] INFO: Scrape type for BT48733: 2
2026-03-30 06:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733
2026-03-30 06:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24205427-2b64-5c45-941a-a84c4ee8095c with scrape type 2
2026-03-30 06:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24205427-2b64-5c45-941a-a84c4ee8095c with scrape type 2
2026-03-30 06:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24205427-2b64-5c45-941a-a84c4ee8095c, identifier: BT48733
2026-03-30 06:37:07 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-30 06:37:07 [auto1.be] INFO: Scrape type for TF43790: 2
2026-03-30 06:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790
2026-03-30 06:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a70cb9-5cef-5226-a478-6868bba028a7 with scrape type 2
2026-03-30 06:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21a70cb9-5cef-5226-a478-6868bba028a7 with scrape type 2
2026-03-30 06:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21a70cb9-5cef-5226-a478-6868bba028a7, identifier: TF43790
2026-03-30 06:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733
2026-03-30 06:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733
2026-03-30 06:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733 to the API
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:23:26Z',
 'fuel_type': 'petrol',
 'id': '24205427-2b64-5c45-941a-a84c4ee8095c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT48733',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 51991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-30 06:37:08 [auto1.be] INFO: Saving data for BT48733: {'auction_closing_time': 1774884206.0, 'created_time': 1774730275.445991, 'last_price_update_time': 1774852628.308312}
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT48733') HTTP/1.1" 204 0
2026-03-30 06:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790
2026-03-30 06:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790
2026-03-30 06:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790 to the API
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:02:13Z',
 'fuel_type': 'diesel',
 'id': '21a70cb9-5cef-5226-a478-6868bba028a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF43790',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 200822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-15',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Tonic',
 'transmission': 'manual',
 'trim': 'Tonic',
 'year': 2014}
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-30 06:37:08 [auto1.be] INFO: Saving data for TF43790: {'auction_closing_time': 1774882933.0, 'created_time': 1774730281.603616, 'last_price_update_time': 1774852628.58278}
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF43790') HTTP/1.1" 204 0
2026-03-30 06:37:08 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-30 06:37:08 [auto1.be] INFO: Scrape type for JM52918: 2
2026-03-30 06:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918
2026-03-30 06:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0a8e239-b960-532c-8eca-7b398758a426 with scrape type 2
2026-03-30 06:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0a8e239-b960-532c-8eca-7b398758a426 with scrape type 2
2026-03-30 06:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0a8e239-b960-532c-8eca-7b398758a426, identifier: JM52918
2026-03-30 06:37:08 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-30 06:37:08 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-30 06:37:08 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-30 06:37:08 [auto1.be] INFO: Scrape type for LF44164: 2
2026-03-30 06:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164
2026-03-30 06:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with scrape type 2
2026-03-30 06:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with scrape type 2
2026-03-30 06:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1, identifier: LF44164
2026-03-30 06:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918
2026-03-30 06:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918
2026-03-30 06:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918 to the API
2026-03-30 06:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:22Z',
 'fuel_type': 'diesel',
 'id': 'e0a8e239-b960-532c-8eca-7b398758a426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM52918',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 160718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-23',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-30 06:37:09 [auto1.be] INFO: Saving data for JM52918: {'auction_closing_time': 1774884982.0, 'created_time': 1774730296.618869, 'last_price_update_time': 1774852629.127833}
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM52918') HTTP/1.1" 204 0
2026-03-30 06:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164
2026-03-30 06:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164
2026-03-30 06:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164 to the API
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'petrol',
 'id': 'c1b7697c-9119-588c-8a4c-0f45ae3c3ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF44164',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 79602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2010}
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-30 06:37:09 [auto1.be] INFO: Saving data for LF44164: {'auction_closing_time': 1774882891.0, 'created_time': 1774730276.241131, 'last_price_update_time': 1774852629.414702}
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF44164') HTTP/1.1" 204 0
2026-03-30 06:37:09 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-30 06:37:09 [auto1.be] INFO: Scrape type for PJ47204: 2
2026-03-30 06:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204
2026-03-30 06:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with scrape type 2
2026-03-30 06:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with scrape type 2
2026-03-30 06:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b, identifier: PJ47204
2026-03-30 06:37:09 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-30 06:37:09 [auto1.be] INFO: Scrape type for SV00163: 2
2026-03-30 06:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163
2026-03-30 06:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c566c069-0a72-54bc-ab15-e9ef17b296a2 with scrape type 2
2026-03-30 06:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c566c069-0a72-54bc-ab15-e9ef17b296a2 with scrape type 2
2026-03-30 06:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c566c069-0a72-54bc-ab15-e9ef17b296a2, identifier: SV00163
2026-03-30 06:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204
2026-03-30 06:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204
2026-03-30 06:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204 to the API
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:31Z',
 'fuel_type': 'diesel',
 'id': '959327f5-1ae3-5e5a-b260-6aa0fa096f6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ47204',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 177376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-04',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 e-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2013}
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-30 06:37:09 [auto1.be] INFO: Saving data for PJ47204: {'auction_closing_time': 1774885171.0, 'created_time': 1774730309.286503, 'last_price_update_time': 1774852629.930432}
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ47204') HTTP/1.1" 204 0
2026-03-30 06:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163
2026-03-30 06:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163
2026-03-30 06:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163 to the API
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:40:17Z',
 'fuel_type': 'petrol',
 'id': 'c566c069-0a72-54bc-ab15-e9ef17b296a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV00163',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 166532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-30 06:37:10 [auto1.be] INFO: Saving data for SV00163: {'auction_closing_time': 1774885217.0, 'created_time': 1774730276.738855, 'last_price_update_time': 1774852630.293049}
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV00163') HTTP/1.1" 204 0
2026-03-30 06:37:10 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-30 06:37:10 [auto1.be] INFO: Scrape type for WV93881: 2
2026-03-30 06:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881
2026-03-30 06:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf7c4402-af64-5c36-832b-26e1e864a31b with scrape type 2
2026-03-30 06:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf7c4402-af64-5c36-832b-26e1e864a31b with scrape type 2
2026-03-30 06:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf7c4402-af64-5c36-832b-26e1e864a31b, identifier: WV93881
2026-03-30 06:37:10 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-30 06:37:10 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-30 06:37:10 [auto1.be] INFO: Scrape type for VM07385: 2
2026-03-30 06:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385
2026-03-30 06:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with scrape type 2
2026-03-30 06:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with scrape type 2
2026-03-30 06:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c, identifier: VM07385
2026-03-30 06:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881
2026-03-30 06:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881
2026-03-30 06:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881 to the API
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:46:59Z',
 'fuel_type': 'diesel',
 'id': 'bf7c4402-af64-5c36-832b-26e1e864a31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV93881',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 188305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-30 06:37:10 [auto1.be] INFO: Saving data for WV93881: {'auction_closing_time': 1774885619.0, 'created_time': 1774730311.552316, 'last_price_update_time': 1774852630.795488}
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV93881') HTTP/1.1" 204 0
2026-03-30 06:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385
2026-03-30 06:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385
2026-03-30 06:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385 to the API
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:48Z',
 'fuel_type': 'diesel',
 'id': 'c158ab2c-d2b1-52b4-8ce7-d3694263ba9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM07385',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 219636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-17',
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LT',
 'transmission': 'automatic',
 'trim': 'LT',
 'year': 2011}
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-30 06:37:11 [auto1.be] INFO: Saving data for VM07385: {'auction_closing_time': 1774885728.0, 'created_time': 1774730263.048777, 'last_price_update_time': 1774852631.099511}
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM07385') HTTP/1.1" 204 0
2026-03-30 06:37:11 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-30 06:37:11 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-30 06:37:11 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-30 06:37:11 [auto1.be] INFO: Scrape type for WV93759: 2
2026-03-30 06:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759
2026-03-30 06:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with scrape type 2
2026-03-30 06:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with scrape type 2
2026-03-30 06:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5, identifier: WV93759
2026-03-30 06:37:11 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-30 06:37:11 [auto1.be] INFO: Scrape type for WC19794: 2
2026-03-30 06:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794
2026-03-30 06:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c904cb93-d0db-589e-806e-6cd84b372f27 with scrape type 2
2026-03-30 06:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c904cb93-d0db-589e-806e-6cd84b372f27 with scrape type 2
2026-03-30 06:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c904cb93-d0db-589e-806e-6cd84b372f27, identifier: WC19794
2026-03-30 06:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759
2026-03-30 06:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759
2026-03-30 06:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759 to the API
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': '871dfe9d-1abf-5afc-8f0f-35fc3a0153c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV93759',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 137459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-25',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-30 06:37:11 [auto1.be] INFO: Saving data for WV93759: {'auction_closing_time': 1774886163.0, 'created_time': 1774730316.558567, 'last_price_update_time': 1774852631.621505}
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV93759') HTTP/1.1" 204 0
2026-03-30 06:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794
2026-03-30 06:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794
2026-03-30 06:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794 to the API
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:13Z',
 'fuel_type': 'diesel',
 'id': 'c904cb93-d0db-589e-806e-6cd84b372f27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC19794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 134240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-30 06:37:11 [auto1.be] INFO: Saving data for WC19794: {'auction_closing_time': 1774885453.0, 'created_time': 1774730314.246153, 'last_price_update_time': 1774852631.988827}
2026-03-30 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC19794') HTTP/1.1" 204 0
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-30 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-30 06:37:12 [auto1.be] INFO: Scrape type for HZ76034: 2
2026-03-30 06:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034
2026-03-30 06:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with scrape type 2
2026-03-30 06:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with scrape type 2
2026-03-30 06:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec, identifier: HZ76034
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-30 06:37:12 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-30 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-30 06:37:12 [auto1.be] INFO: Scrape type for SB51494: 2
2026-03-30 06:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494
2026-03-30 06:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with scrape type 2
2026-03-30 06:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with scrape type 2
2026-03-30 06:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5, identifier: SB51494
2026-03-30 06:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034
2026-03-30 06:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034
2026-03-30 06:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034 to the API
2026-03-30 06:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:15:24Z',
 'fuel_type': 'diesel',
 'id': 'b039c07a-f512-5b0b-9bf7-7c4a27c3aaec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ76034',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 148249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-30 06:37:13 [auto1.be] INFO: Saving data for HZ76034: {'auction_closing_time': 1774883724.0, 'created_time': 1774730307.654395, 'last_price_update_time': 1774852633.465193}
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ76034') HTTP/1.1" 204 0
2026-03-30 06:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494
2026-03-30 06:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494
2026-03-30 06:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494 to the API
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:00Z',
 'fuel_type': 'diesel',
 'id': 'a8bdd530-5c7a-5298-ba3b-5eda5876d2b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB51494',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 132831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D Highgate',
 'transmission': 'manual',
 'trim': 'Highgate',
 'year': 2013}
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-30 06:37:13 [auto1.be] INFO: Saving data for SB51494: {'auction_closing_time': 1774886160.0, 'created_time': 1774730261.467515, 'last_price_update_time': 1774852633.831315}
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB51494') HTTP/1.1" 204 0
2026-03-30 06:37:13 [auto1.be] INFO: Found listing with ID: US61524
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-30 06:37:13 [auto1.be] INFO: Scrape type for US61524: 2
2026-03-30 06:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524
2026-03-30 06:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with scrape type 2
2026-03-30 06:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with scrape type 2
2026-03-30 06:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf, identifier: US61524
2026-03-30 06:37:13 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-30 06:37:13 [auto1.be] INFO: Scrape type for KM81672: 2
2026-03-30 06:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672
2026-03-30 06:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a with scrape type 2
2026-03-30 06:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a with scrape type 2
2026-03-30 06:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a5d4fd65-25c0-53d8-871c-af4ee329ff5a, identifier: KM81672
2026-03-30 06:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524
2026-03-30 06:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524
2026-03-30 06:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524 to the API
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:01:18Z',
 'fuel_type': 'petrol',
 'id': '6ebf81c9-5e15-5caa-8e88-c09d21ffebaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US61524',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 103049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2012}
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-30 06:37:14 [auto1.be] INFO: Saving data for US61524: {'auction_closing_time': 1774882878.0, 'created_time': 1774730316.029871, 'last_price_update_time': 1774852634.318807}
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='US61524') HTTP/1.1" 204 0
2026-03-30 06:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672
2026-03-30 06:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672
2026-03-30 06:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672 to the API
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:57Z',
 'fuel_type': 'diesel',
 'id': 'a5d4fd65-25c0-53d8-871c-af4ee329ff5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM81672',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 135532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2022}
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-30 06:37:14 [auto1.be] INFO: Saving data for KM81672: {'auction_closing_time': 1774884657.0, 'created_time': 1774730274.315873, 'last_price_update_time': 1774852634.669175}
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM81672') HTTP/1.1" 204 0
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-30 06:37:14 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-30 06:37:14 [auto1.be] INFO: Scrape type for WJ93890: 2
2026-03-30 06:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890
2026-03-30 06:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5cfa43-494b-591c-8fb6-e53de7c77135 with scrape type 2
2026-03-30 06:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5cfa43-494b-591c-8fb6-e53de7c77135 with scrape type 2
2026-03-30 06:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf5cfa43-494b-591c-8fb6-e53de7c77135, identifier: WJ93890
2026-03-30 06:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890
2026-03-30 06:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890
2026-03-30 06:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890 to the API
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'bf5cfa43-494b-591c-8fb6-e53de7c77135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ93890',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 151543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-30 06:37:15 [auto1.be] INFO: Saving data for WJ93890: {'auction_closing_time': 1774884609.0, 'created_time': 1774730312.78887, 'last_price_update_time': 1774852635.085914}
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ93890') HTTP/1.1" 204 0
2026-03-30 06:37:15 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-30 06:37:15 [auto1.be] INFO: Scrape type for DN00999: 2
2026-03-30 06:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999
2026-03-30 06:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f14dc5-80b1-5f56-9057-112117330efe with scrape type 2
2026-03-30 06:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f14dc5-80b1-5f56-9057-112117330efe with scrape type 2
2026-03-30 06:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2f14dc5-80b1-5f56-9057-112117330efe, identifier: DN00999
2026-03-30 06:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999
2026-03-30 06:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999
2026-03-30 06:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999 to the API
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': 'c2f14dc5-80b1-5f56-9057-112117330efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN00999',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 125327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': "Kia cee'd 1.4 UEFA Euro 2016",
 'transmission': 'manual',
 'trim': 'UEFA Euro 2016',
 'year': 2015}
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-30 06:37:15 [auto1.be] INFO: Saving data for DN00999: {'auction_closing_time': 1774886275.0, 'created_time': 1774730338.523307, 'last_price_update_time': 1774852635.474292}
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DN00999') HTTP/1.1" 204 0
2026-03-30 06:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:15 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-30 06:37:15 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-30 06:37:15 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-30 06:37:15 [auto1.be] INFO: Scrape type for ZW40078: 2
2026-03-30 06:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078
2026-03-30 06:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e with scrape type 2
2026-03-30 06:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e with scrape type 2
2026-03-30 06:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80e02369-3c33-5065-bd4c-c515e4a1ff8e, identifier: ZW40078
2026-03-30 06:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078
2026-03-30 06:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078
2026-03-30 06:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078 to the API
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:37:31Z',
 'fuel_type': 'diesel',
 'id': '80e02369-3c33-5065-bd4c-c515e4a1ff8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW40078',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 74527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-30 06:37:15 [auto1.be] INFO: Saving data for ZW40078: {'auction_closing_time': 1774885051.0, 'created_time': 1774730293.284936, 'last_price_update_time': 1774852635.944731}
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZW40078') HTTP/1.1" 204 0
2026-03-30 06:37:15 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-30 06:37:15 [auto1.be] INFO: Scrape type for YW96446: 2
2026-03-30 06:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446
2026-03-30 06:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with scrape type 2
2026-03-30 06:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with scrape type 2
2026-03-30 06:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf, identifier: YW96446
2026-03-30 06:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446
2026-03-30 06:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446
2026-03-30 06:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446 to the API
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:16Z',
 'fuel_type': 'diesel',
 'id': '63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW96446',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 185780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-13',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Acenta',
 'transmission': 'manual',
 'trim': 'Evalia Acenta',
 'year': 2013}
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-30 06:37:16 [auto1.be] INFO: Saving data for YW96446: {'auction_closing_time': 1774883836.0, 'created_time': 1774730283.211219, 'last_price_update_time': 1774852636.324631}
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW96446') HTTP/1.1" 204 0
2026-03-30 06:37:16 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-30 06:37:16 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-30 06:37:16 [auto1.be] INFO: Scrape type for UE64828: 2
2026-03-30 06:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828
2026-03-30 06:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f450e3-7457-5d77-9aee-a84b8a5feff9 with scrape type 2
2026-03-30 06:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f450e3-7457-5d77-9aee-a84b8a5feff9 with scrape type 2
2026-03-30 06:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52f450e3-7457-5d77-9aee-a84b8a5feff9, identifier: UE64828
2026-03-30 06:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828
2026-03-30 06:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828
2026-03-30 06:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828 to the API
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:50:11Z',
 'fuel_type': 'diesel',
 'id': '52f450e3-7457-5d77-9aee-a84b8a5feff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE64828',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 202319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-30',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-30 06:37:16 [auto1.be] INFO: Saving data for UE64828: {'auction_closing_time': 1774885811.0, 'created_time': 1774730284.072501, 'last_price_update_time': 1774852636.72645}
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE64828') HTTP/1.1" 204 0
2026-03-30 06:37:16 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1289 | hits on page: 40
2026-03-30 06:37:16 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-30 06:37:16 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-30 06:37:16 [auto1.be] INFO: Scrape type for KF94293: 2
2026-03-30 06:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293
2026-03-30 06:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830f3b14-21de-50cb-af11-f25c3a379396 with scrape type 2
2026-03-30 06:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830f3b14-21de-50cb-af11-f25c3a379396 with scrape type 2
2026-03-30 06:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 830f3b14-21de-50cb-af11-f25c3a379396, identifier: KF94293
2026-03-30 06:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293
2026-03-30 06:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293
2026-03-30 06:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293 to the API
2026-03-30 06:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:45Z',
 'fuel_type': 'diesel',
 'id': '830f3b14-21de-50cb-af11-f25c3a379396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF94293',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 159312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-15',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2013}
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-30 06:37:17 [auto1.be] INFO: Saving data for KF94293: {'auction_closing_time': 1774885005.0, 'created_time': 1774730272.890768, 'last_price_update_time': 1774852637.166189}
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF94293') HTTP/1.1" 204 0
2026-03-30 06:37:17 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-30 06:37:17 [auto1.be] INFO: Scrape type for LM13926: 2
2026-03-30 06:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926
2026-03-30 06:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec with scrape type 2
2026-03-30 06:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec with scrape type 2
2026-03-30 06:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18907c7b-024a-5777-a8e1-8a4ea18d99ec, identifier: LM13926
2026-03-30 06:37:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:17 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-30 06:37:17 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-30 06:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926
2026-03-30 06:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926
2026-03-30 06:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926 to the API
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:49Z',
 'fuel_type': 'petrol',
 'id': '18907c7b-024a-5777-a8e1-8a4ea18d99ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM13926',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 166420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-26',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2013}
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-30 06:37:17 [auto1.be] INFO: Saving data for LM13926: {'auction_closing_time': 1774883329.0, 'created_time': 1774730299.587134, 'last_price_update_time': 1774852637.575462}
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM13926') HTTP/1.1" 204 0
2026-03-30 06:37:17 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-30 06:37:17 [auto1.be] INFO: Scrape type for AE63964: 2
2026-03-30 06:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964
2026-03-30 06:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with scrape type 2
2026-03-30 06:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with scrape type 2
2026-03-30 06:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2, identifier: AE63964
2026-03-30 06:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964
2026-03-30 06:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964
2026-03-30 06:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964 to the API
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:49:36Z',
 'fuel_type': 'petrol',
 'id': '4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE63964',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 135472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-30',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2011}
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-30 06:37:18 [auto1.be] INFO: Saving data for AE63964: {'auction_closing_time': 1774885776.0, 'created_time': 1774730273.243791, 'last_price_update_time': 1774852638.109753}
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE63964') HTTP/1.1" 204 0
2026-03-30 06:37:18 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-30 06:37:18 [auto1.be] INFO: Scrape type for SL57288: 2
2026-03-30 06:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288
2026-03-30 06:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58835f8b-49e1-5b95-ab54-d689049ca436 with scrape type 2
2026-03-30 06:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58835f8b-49e1-5b95-ab54-d689049ca436 with scrape type 2
2026-03-30 06:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58835f8b-49e1-5b95-ab54-d689049ca436, identifier: SL57288
2026-03-30 06:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288
2026-03-30 06:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288
2026-03-30 06:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288 to the API
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:35:42Z',
 'fuel_type': 'diesel',
 'id': '58835f8b-49e1-5b95-ab54-d689049ca436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL57288',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 82500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 D V6 Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2011}
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-30 06:37:18 [auto1.be] INFO: Saving data for SL57288: {'auction_closing_time': 1774884942.0, 'created_time': 1773351497.729516, 'last_price_update_time': 1774852638.521852}
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL57288') HTTP/1.1" 204 0
2026-03-30 06:37:18 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-30 06:37:18 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-30 06:37:18 [auto1.be] INFO: Scrape type for RK43455: 2
2026-03-30 06:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455
2026-03-30 06:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423a3563-48c9-520f-b109-1929aa182f5f with scrape type 2
2026-03-30 06:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 423a3563-48c9-520f-b109-1929aa182f5f with scrape type 2
2026-03-30 06:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 423a3563-48c9-520f-b109-1929aa182f5f, identifier: RK43455
2026-03-30 06:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455
2026-03-30 06:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455
2026-03-30 06:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455 to the API
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:44Z',
 'fuel_type': 'diesel',
 'id': '423a3563-48c9-520f-b109-1929aa182f5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK43455',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 124696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-30 06:37:18 [auto1.be] INFO: Saving data for RK43455: {'auction_closing_time': 1774884044.0, 'created_time': 1774730262.404694, 'last_price_update_time': 1774852638.926139}
2026-03-30 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK43455') HTTP/1.1" 204 0
2026-03-30 06:37:19 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-30 06:37:19 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-30 06:37:19 [auto1.be] INFO: Scrape type for FB93927: 2
2026-03-30 06:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927
2026-03-30 06:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with scrape type 2
2026-03-30 06:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with scrape type 2
2026-03-30 06:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23, identifier: FB93927
2026-03-30 06:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927
2026-03-30 06:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927
2026-03-30 06:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927 to the API
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'petrol',
 'id': '18bd56cb-22cf-5c76-bd47-4f6893cd7b23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB93927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 7188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 Mild-Hybrid 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2024}
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-30 06:37:19 [auto1.be] INFO: Saving data for FB93927: {'auction_closing_time': 1774884514.0, 'created_time': 1773384628.77735, 'last_price_update_time': 1774852639.470099}
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FB93927') HTTP/1.1" 204 0
2026-03-30 06:37:19 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-30 06:37:19 [auto1.be] INFO: Scrape type for SV46049: 2
2026-03-30 06:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049
2026-03-30 06:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeee6ef-1a80-5b7b-a120-43a05c9df56f with scrape type 2
2026-03-30 06:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeee6ef-1a80-5b7b-a120-43a05c9df56f with scrape type 2
2026-03-30 06:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeee6ef-1a80-5b7b-a120-43a05c9df56f, identifier: SV46049
2026-03-30 06:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049
2026-03-30 06:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049
2026-03-30 06:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049 to the API
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 126,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'petrol',
 'id': 'deeee6ef-1a80-5b7b-a120-43a05c9df56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV46049',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 157744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-15',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2019}
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-30 06:37:19 [auto1.be] INFO: Saving data for SV46049: {'auction_closing_time': 1774884616.0, 'created_time': 1774006556.233853, 'last_price_update_time': 1774852639.991667}
2026-03-30 06:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV46049') HTTP/1.1" 204 0
2026-03-30 06:37:20 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-30 06:37:20 [auto1.be] INFO: Scrape type for WV65314: 2
2026-03-30 06:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314
2026-03-30 06:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2177c307-6709-58df-b329-39d688b55b6a with scrape type 2
2026-03-30 06:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2177c307-6709-58df-b329-39d688b55b6a with scrape type 2
2026-03-30 06:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2177c307-6709-58df-b329-39d688b55b6a, identifier: WV65314
2026-03-30 06:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314
2026-03-30 06:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314
2026-03-30 06:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314 to the API
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'diesel',
 'id': '2177c307-6709-58df-b329-39d688b55b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV65314',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 105607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-10',
 'seller_name': None,
 'title': 'Volvo S60 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2011}
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-30 06:37:20 [auto1.be] INFO: Saving data for WV65314: {'auction_closing_time': 1774883322.0, 'created_time': 1774730268.961938, 'last_price_update_time': 1774852640.410211}
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV65314') HTTP/1.1" 204 0
2026-03-30 06:37:20 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-30 06:37:20 [auto1.be] INFO: Scrape type for FM81572: 2
2026-03-30 06:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572
2026-03-30 06:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c with scrape type 2
2026-03-30 06:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c with scrape type 2
2026-03-30 06:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6c68ad6-7c99-59b2-98ae-3d05615ae67c, identifier: FM81572
2026-03-30 06:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572
2026-03-30 06:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572
2026-03-30 06:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572 to the API
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:23:38Z',
 'fuel_type': 'diesel',
 'id': 'b6c68ad6-7c99-59b2-98ae-3d05615ae67c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM81572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 116522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2008}
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-30 06:37:20 [auto1.be] INFO: Saving data for FM81572: {'auction_closing_time': 1774884218.0, 'created_time': 1774730290.605931, 'last_price_update_time': 1774852640.883885}
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM81572') HTTP/1.1" 204 0
2026-03-30 06:37:20 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-30 06:37:20 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-30 06:37:20 [auto1.be] INFO: Scrape type for MW50956: 2
2026-03-30 06:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956
2026-03-30 06:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with scrape type 2
2026-03-30 06:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with scrape type 2
2026-03-30 06:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 933c4ebd-e39a-55f7-8abd-7b2ee3936342, identifier: MW50956
2026-03-30 06:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956
2026-03-30 06:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956
2026-03-30 06:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956 to the API
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'hybrid',
 'id': '933c4ebd-e39a-55f7-8abd-7b2ee3936342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW50956',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 240915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-17',
 'seller_name': None,
 'title': 'Porsche Panamera 4 E-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-30 06:37:21 [auto1.be] INFO: Saving data for MW50956: {'auction_closing_time': 1774885949.0, 'created_time': 1774730299.207849, 'last_price_update_time': 1774852641.277174}
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW50956') HTTP/1.1" 204 0
2026-03-30 06:37:21 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-30 06:37:21 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-30 06:37:21 [auto1.be] INFO: Scrape type for DN28044: 2
2026-03-30 06:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044
2026-03-30 06:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab18226-1036-599b-8f80-36020af12c19 with scrape type 2
2026-03-30 06:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bab18226-1036-599b-8f80-36020af12c19 with scrape type 2
2026-03-30 06:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bab18226-1036-599b-8f80-36020af12c19, identifier: DN28044
2026-03-30 06:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044
2026-03-30 06:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044
2026-03-30 06:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044 to the API
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:10Z',
 'fuel_type': 'diesel',
 'id': 'bab18226-1036-599b-8f80-36020af12c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN28044',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 271740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-30 06:37:21 [auto1.be] INFO: Saving data for DN28044: {'auction_closing_time': 1774886290.0, 'created_time': 1774730290.957755, 'last_price_update_time': 1774852641.765885}
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DN28044') HTTP/1.1" 204 0
2026-03-30 06:37:21 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1290 | hits on page: 40
2026-03-30 06:37:21 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-30 06:37:21 [auto1.be] INFO: Scrape type for WG38275: 2
2026-03-30 06:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275
2026-03-30 06:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1add7b67-ee09-5549-b8ef-1df57d6a7640 with scrape type 2
2026-03-30 06:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1add7b67-ee09-5549-b8ef-1df57d6a7640 with scrape type 2
2026-03-30 06:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1add7b67-ee09-5549-b8ef-1df57d6a7640, identifier: WG38275
2026-03-30 06:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275
2026-03-30 06:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275
2026-03-30 06:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275 to the API
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:19Z',
 'fuel_type': 'diesel',
 'id': '1add7b67-ee09-5549-b8ef-1df57d6a7640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG38275',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 160029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-12',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
 'transmission': 'manual',
 'trim': 'Style blue 2WD',
 'year': 2018}
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-30 06:37:22 [auto1.be] INFO: Saving data for WG38275: {'auction_closing_time': 1774883359.0, 'created_time': 1774730317.315221, 'last_price_update_time': 1774852642.189336}
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG38275') HTTP/1.1" 204 0
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-30 06:37:22 [auto1.be] INFO: Scrape type for HK87235: 2
2026-03-30 06:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235
2026-03-30 06:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d8eb18-487e-5954-a26d-1588a8718da3 with scrape type 2
2026-03-30 06:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d8eb18-487e-5954-a26d-1588a8718da3 with scrape type 2
2026-03-30 06:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3d8eb18-487e-5954-a26d-1588a8718da3, identifier: HK87235
2026-03-30 06:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-30 06:37:22 [auto1.be] INFO: Scrape type for NC08569: 2
2026-03-30 06:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569
2026-03-30 06:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e188e062-a9f0-58fa-9f76-49d2a96b9460 with scrape type 2
2026-03-30 06:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e188e062-a9f0-58fa-9f76-49d2a96b9460 with scrape type 2
2026-03-30 06:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e188e062-a9f0-58fa-9f76-49d2a96b9460, identifier: NC08569
2026-03-30 06:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235
2026-03-30 06:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235
2026-03-30 06:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235 to the API
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:57Z',
 'fuel_type': 'diesel',
 'id': 'c3d8eb18-487e-5954-a26d-1588a8718da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK87235',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 164615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2015}
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-30 06:37:22 [auto1.be] INFO: Saving data for HK87235: {'auction_closing_time': 1774886337.0, 'created_time': 1774730295.111009, 'last_price_update_time': 1774852642.686282}
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK87235') HTTP/1.1" 204 0
2026-03-30 06:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569
2026-03-30 06:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569
2026-03-30 06:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569 to the API
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:20:43Z',
 'fuel_type': 'diesel',
 'id': 'e188e062-a9f0-58fa-9f76-49d2a96b9460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC08569',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 99884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d Premiere',
 'transmission': 'automatic',
 'trim': 'Premiere',
 'year': 2018}
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-30 06:37:22 [auto1.be] INFO: Saving data for NC08569: {'auction_closing_time': 1774884043.0, 'created_time': 1774730295.474642, 'last_price_update_time': 1774852642.964304}
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC08569') HTTP/1.1" 204 0
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-30 06:37:22 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-30 06:37:22 [auto1.be] INFO: Scrape type for CD22470: 2
2026-03-30 06:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470
2026-03-30 06:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580a2be0-03e5-501a-abfb-e50d3f47824e with scrape type 2
2026-03-30 06:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580a2be0-03e5-501a-abfb-e50d3f47824e with scrape type 2
2026-03-30 06:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 580a2be0-03e5-501a-abfb-e50d3f47824e, identifier: CD22470
2026-03-30 06:37:23 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-30 06:37:23 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-30 06:37:23 [auto1.be] INFO: Scrape type for CF30779: 2
2026-03-30 06:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779
2026-03-30 06:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 846b5e02-6831-5198-99db-401c2272aa06 with scrape type 2
2026-03-30 06:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 846b5e02-6831-5198-99db-401c2272aa06 with scrape type 2
2026-03-30 06:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 846b5e02-6831-5198-99db-401c2272aa06, identifier: CF30779
2026-03-30 06:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470
2026-03-30 06:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470
2026-03-30 06:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470 to the API
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:10:19Z',
 'fuel_type': 'petrol',
 'id': '580a2be0-03e5-501a-abfb-e50d3f47824e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD22470',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 142922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-30 06:37:23 [auto1.be] INFO: Saving data for CD22470: {'auction_closing_time': 1774883419.0, 'created_time': 1773384588.893456, 'last_price_update_time': 1774852643.568155}
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD22470') HTTP/1.1" 204 0
2026-03-30 06:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779
2026-03-30 06:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779
2026-03-30 06:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779 to the API
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:25:17Z',
 'fuel_type': 'diesel',
 'id': '846b5e02-6831-5198-99db-401c2272aa06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF30779',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 230633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-28',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi XTR',
 'transmission': 'manual',
 'trim': 'XTR',
 'year': 2014}
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-30 06:37:23 [auto1.be] INFO: Saving data for CF30779: {'auction_closing_time': 1774884317.0, 'created_time': 1774730349.904514, 'last_price_update_time': 1774852643.950926}
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF30779') HTTP/1.1" 204 0
2026-03-30 06:37:23 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-30 06:37:23 [auto1.be] INFO: Scrape type for SJ05954: 2
2026-03-30 06:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954
2026-03-30 06:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13b0eda-93fc-5b98-8fda-c0484df24600 with scrape type 2
2026-03-30 06:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13b0eda-93fc-5b98-8fda-c0484df24600 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e13b0eda-93fc-5b98-8fda-c0484df24600, identifier: SJ05954
2026-03-30 06:37:24 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-30 06:37:24 [auto1.be] INFO: Scrape type for WT53046: 2
2026-03-30 06:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046
2026-03-30 06:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea768c27-2111-53e1-a91e-359a3db3b812 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea768c27-2111-53e1-a91e-359a3db3b812 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea768c27-2111-53e1-a91e-359a3db3b812, identifier: WT53046
2026-03-30 06:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954
2026-03-30 06:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954
2026-03-30 06:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954 to the API
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:32Z',
 'fuel_type': 'diesel',
 'id': 'e13b0eda-93fc-5b98-8fda-c0484df24600',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ05954',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 154257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-30 06:37:24 [auto1.be] INFO: Saving data for SJ05954: {'auction_closing_time': 1774884032.0, 'created_time': 1774730280.088152, 'last_price_update_time': 1774852644.454866}
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ05954') HTTP/1.1" 204 0
2026-03-30 06:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046
2026-03-30 06:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046
2026-03-30 06:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046 to the API
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'diesel',
 'id': 'ea768c27-2111-53e1-a91e-359a3db3b812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT53046',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 176831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-07',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-30 06:37:24 [auto1.be] INFO: Saving data for WT53046: {'auction_closing_time': 1774886120.0, 'created_time': 1774730291.686105, 'last_price_update_time': 1774852644.729432}
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT53046') HTTP/1.1" 204 0
2026-03-30 06:37:24 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-30 06:37:24 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-30 06:37:24 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-30 06:37:24 [auto1.be] INFO: Scrape type for FV90992: 2
2026-03-30 06:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992
2026-03-30 06:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8523aa88-2017-5043-95f6-adce869f3380 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8523aa88-2017-5043-95f6-adce869f3380 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8523aa88-2017-5043-95f6-adce869f3380, identifier: FV90992
2026-03-30 06:37:24 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-30 06:37:24 [auto1.be] INFO: Scrape type for DR48094: 2
2026-03-30 06:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094
2026-03-30 06:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa343cee-1df5-5d21-b139-41ed088a54d3 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa343cee-1df5-5d21-b139-41ed088a54d3 with scrape type 2
2026-03-30 06:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa343cee-1df5-5d21-b139-41ed088a54d3, identifier: DR48094
2026-03-30 06:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992
2026-03-30 06:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992
2026-03-30 06:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992 to the API
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:38Z',
 'fuel_type': 'petrol',
 'id': '8523aa88-2017-5043-95f6-adce869f3380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV90992',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 87048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2015}
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-30 06:37:25 [auto1.be] INFO: Saving data for FV90992: {'auction_closing_time': 1774883198.0, 'created_time': 1774730279.317328, 'last_price_update_time': 1774852645.212349}
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV90992') HTTP/1.1" 204 0
2026-03-30 06:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094
2026-03-30 06:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094
2026-03-30 06:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094 to the API
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:41:41Z',
 'fuel_type': 'petrol',
 'id': 'fa343cee-1df5-5d21-b139-41ed088a54d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR48094',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 112679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2014}
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-30 06:37:25 [auto1.be] INFO: Saving data for DR48094: {'auction_closing_time': 1774885301.0, 'created_time': 1774730302.462637, 'last_price_update_time': 1774852645.49211}
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DR48094') HTTP/1.1" 204 0
2026-03-30 06:37:25 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-30 06:37:25 [auto1.be] INFO: Scrape type for PG48700: 2
2026-03-30 06:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700
2026-03-30 06:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74f26fb-36f0-509f-a87e-00f6931e2718 with scrape type 2
2026-03-30 06:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f74f26fb-36f0-509f-a87e-00f6931e2718 with scrape type 2
2026-03-30 06:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f74f26fb-36f0-509f-a87e-00f6931e2718, identifier: PG48700
2026-03-30 06:37:25 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-30 06:37:25 [auto1.be] INFO: Scrape type for JZ34939: 2
2026-03-30 06:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939
2026-03-30 06:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b8cd90-df8b-5835-a6e3-504455c8285b with scrape type 2
2026-03-30 06:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b8cd90-df8b-5835-a6e3-504455c8285b with scrape type 2
2026-03-30 06:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 02b8cd90-df8b-5835-a6e3-504455c8285b, identifier: JZ34939
2026-03-30 06:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700
2026-03-30 06:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700
2026-03-30 06:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700 to the API
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:53:32Z',
 'fuel_type': 'petrol',
 'id': 'f74f26fb-36f0-509f-a87e-00f6931e2718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG48700',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-18',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-30 06:37:26 [auto1.be] INFO: Saving data for PG48700: {'auction_closing_time': 1774886012.0, 'created_time': 1774730268.248148, 'last_price_update_time': 1774852646.051491}
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PG48700') HTTP/1.1" 204 0
2026-03-30 06:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939
2026-03-30 06:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939
2026-03-30 06:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939 to the API
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'diesel',
 'id': '02b8cd90-df8b-5835-a6e3-504455c8285b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ34939',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 198065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2017}
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-30 06:37:26 [auto1.be] INFO: Saving data for JZ34939: {'auction_closing_time': 1774885120.0, 'created_time': 1773384097.361093, 'last_price_update_time': 1774852646.330824}
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ34939') HTTP/1.1" 204 0
2026-03-30 06:37:26 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-30 06:37:26 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-30 06:37:26 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-30 06:37:26 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-30 06:37:26 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-30 06:37:26 [auto1.be] INFO: Scrape type for DC62563: 2
2026-03-30 06:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563
2026-03-30 06:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b97ab06-82dc-5178-a422-0105984d638c with scrape type 2
2026-03-30 06:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b97ab06-82dc-5178-a422-0105984d638c with scrape type 2
2026-03-30 06:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b97ab06-82dc-5178-a422-0105984d638c, identifier: DC62563
2026-03-30 06:37:26 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-30 06:37:26 [auto1.be] INFO: Scrape type for TX04561: 2
2026-03-30 06:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561
2026-03-30 06:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abae9bda-841d-555b-bbc5-bed535ae796f with scrape type 2
2026-03-30 06:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abae9bda-841d-555b-bbc5-bed535ae796f with scrape type 2
2026-03-30 06:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abae9bda-841d-555b-bbc5-bed535ae796f, identifier: TX04561
2026-03-30 06:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563
2026-03-30 06:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563
2026-03-30 06:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563 to the API
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:48:54Z',
 'fuel_type': 'petrol',
 'id': '2b97ab06-82dc-5178-a422-0105984d638c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC62563',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 146523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-31',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-30 06:37:26 [auto1.be] INFO: Saving data for DC62563: {'auction_closing_time': 1774885734.0, 'created_time': 1774730272.421566, 'last_price_update_time': 1774852646.825191}
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC62563') HTTP/1.1" 204 0
2026-03-30 06:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561
2026-03-30 06:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561
2026-03-30 06:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561 to the API
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:04:39Z',
 'fuel_type': 'diesel',
 'id': 'abae9bda-841d-555b-bbc5-bed535ae796f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX04561',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 200350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-07',
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Saving data for TX04561: {'auction_closing_time': 1774883079.0, 'created_time': 1773995761.034204, 'last_price_update_time': 1774852647.224314}
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX04561') HTTP/1.1" 204 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for ZP95092: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for ZR35447: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for CA54828: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for FW70524: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for NZ74768: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for AC55620: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for YZ92764: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for ZZ63767: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for VW23905: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for XC95069: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for BS70441: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for GM14941: 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Scrape type for BC33060: 2
2026-03-30 06:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060
2026-03-30 06:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebf50b4-dc41-581e-b942-9c95e5e59370 with scrape type 2
2026-03-30 06:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebf50b4-dc41-581e-b942-9c95e5e59370 with scrape type 2
2026-03-30 06:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ebf50b4-dc41-581e-b942-9c95e5e59370, identifier: BC33060
2026-03-30 06:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060
2026-03-30 06:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060
2026-03-30 06:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060 to the API
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-30T15:01:24Z',
 'fuel_type': 'petrol',
 'id': '4ebf50b4-dc41-581e-b942-9c95e5e59370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC33060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 16390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-30 06:37:27 [auto1.be] INFO: Saving data for BC33060: {'auction_closing_time': 1774882884.0, 'created_time': 1774730292.911532, 'last_price_update_time': 1774852647.881383}
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC33060') HTTP/1.1" 204 0
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-30 06:37:27 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-30 06:37:28 [auto1.be] INFO: Scrape type for EP00364: 2
2026-03-30 06:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364
2026-03-30 06:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906e976f-cfb4-5d17-8a93-23a374ca7175 with scrape type 2
2026-03-30 06:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 906e976f-cfb4-5d17-8a93-23a374ca7175 with scrape type 2
2026-03-30 06:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 906e976f-cfb4-5d17-8a93-23a374ca7175, identifier: EP00364
2026-03-30 06:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364
2026-03-30 06:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364
2026-03-30 06:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364 to the API
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:56:35Z',
 'fuel_type': 'diesel',
 'id': '906e976f-cfb4-5d17-8a93-23a374ca7175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP00364',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 113451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranSport',
 'transmission': 'automatic',
 'trim': 'GranSport',
 'year': 2017}
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-30 06:37:28 [auto1.be] INFO: Saving data for EP00364: {'auction_closing_time': 1774886195.0, 'created_time': 1774730284.801816, 'last_price_update_time': 1774852648.37246}
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP00364') HTTP/1.1" 204 0
2026-03-30 06:37:28 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-30 06:37:28 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-30 06:37:28 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-30 06:37:28 [auto1.be] INFO: Scrape type for HB59214: 2
2026-03-30 06:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214
2026-03-30 06:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a1ba15-27d6-5cc9-b123-c41233090302 with scrape type 2
2026-03-30 06:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a1ba15-27d6-5cc9-b123-c41233090302 with scrape type 2
2026-03-30 06:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2a1ba15-27d6-5cc9-b123-c41233090302, identifier: HB59214
2026-03-30 06:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214
2026-03-30 06:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214
2026-03-30 06:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214 to the API
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'petrol',
 'id': 'd2a1ba15-27d6-5cc9-b123-c41233090302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB59214',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 197980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-01',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-30 06:37:28 [auto1.be] INFO: Saving data for HB59214: {'auction_closing_time': 1774885011.0, 'created_time': 1774730269.499608, 'last_price_update_time': 1774852648.751382}
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB59214') HTTP/1.1" 204 0
2026-03-30 06:37:28 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-30 06:37:28 [auto1.be] INFO: Scrape type for SX95001: 2
2026-03-30 06:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001
2026-03-30 06:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with scrape type 2
2026-03-30 06:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with scrape type 2
2026-03-30 06:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8547ecd8-1b32-5201-8e25-fe5fd07e8355, identifier: SX95001
2026-03-30 06:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001
2026-03-30 06:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001
2026-03-30 06:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001 to the API
2026-03-30 06:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:25Z',
 'fuel_type': 'diesel',
 'id': '8547ecd8-1b32-5201-8e25-fe5fd07e8355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX95001',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 152790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-18',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2013}
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-30 06:37:29 [auto1.be] INFO: Saving data for SX95001: {'auction_closing_time': 1774884925.0, 'created_time': 1774730273.576379, 'last_price_update_time': 1774852649.149481}
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX95001') HTTP/1.1" 204 0
2026-03-30 06:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-30 06:37:29 [auto1.be] INFO: Scrape type for UR33188: 2
2026-03-30 06:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188
2026-03-30 06:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ce2efc-ff21-5895-82b1-00fbe104962f with scrape type 2
2026-03-30 06:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76ce2efc-ff21-5895-82b1-00fbe104962f with scrape type 2
2026-03-30 06:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76ce2efc-ff21-5895-82b1-00fbe104962f, identifier: UR33188
2026-03-30 06:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188
2026-03-30 06:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188
2026-03-30 06:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188 to the API
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:12:54Z',
 'fuel_type': 'diesel',
 'id': '76ce2efc-ff21-5895-82b1-00fbe104962f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR33188',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 137250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 C V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 C V Radstand 3520 L',
 'year': 2019}
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-30 06:37:29 [auto1.be] INFO: Saving data for UR33188: {'auction_closing_time': 1774883574.0, 'created_time': 1774730280.713226, 'last_price_update_time': 1774852649.533563}
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR33188') HTTP/1.1" 204 0
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-30 06:37:29 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-30 06:37:29 [auto1.be] INFO: Scrape type for FJ57746: 2
2026-03-30 06:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746
2026-03-30 06:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3858d21-6175-57b5-b57b-8639f73467a6 with scrape type 2
2026-03-30 06:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3858d21-6175-57b5-b57b-8639f73467a6 with scrape type 2
2026-03-30 06:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3858d21-6175-57b5-b57b-8639f73467a6, identifier: FJ57746
2026-03-30 06:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746
2026-03-30 06:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746
2026-03-30 06:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746 to the API
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'petrol',
 'id': 'f3858d21-6175-57b5-b57b-8639f73467a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ57746',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 54058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-19',
 'seller_name': None,
 'title': 'Audi A4 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-30 06:37:29 [auto1.be] INFO: Saving data for FJ57746: {'auction_closing_time': 1774885991.0, 'created_time': 1774730266.736152, 'last_price_update_time': 1774852649.971905}
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ57746') HTTP/1.1" 204 0
2026-03-30 06:37:30 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1290 | hits on page: 40
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for KZ05274: 2
2026-03-30 06:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274
2026-03-30 06:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with scrape type 2
2026-03-30 06:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with scrape type 2
2026-03-30 06:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd, identifier: KZ05274
2026-03-30 06:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274
2026-03-30 06:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274
2026-03-30 06:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274 to the API
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:54Z',
 'fuel_type': 'diesel',
 'id': '33e16a8d-ed0d-5996-8a8a-a8c07cba38fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05274',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Interstar',
 'odometer': 91290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seller_name': None,
 'title': 'Nissan Interstar 2.3 dCi L3H2 3,5t Acenta FWD',
 'transmission': 'manual',
 'trim': 'L3H2 3,5t Acenta FWD',
 'year': 2022}
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Saving data for KZ05274: {'auction_closing_time': 1774886154.0, 'created_time': 1774730294.120405, 'last_price_update_time': 1774852650.473512}
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ05274') HTTP/1.1" 204 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for SY87797: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for ZV95387: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for KB40459: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for ZZ39097: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for SC10935: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for BU18930: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for CN37182: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for EK79460: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for KE51169: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for XS76018: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for UY92003: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for NV64774: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for ET88330: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for KT00341: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for YH90615: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for CU35051: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for PK02246: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for LY17098: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for FC78029: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for EH00335: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-30 06:37:30 [auto1.be] INFO: Scrape type for WH49963: 0
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 06:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-30 06:37:30 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 06:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:32 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1290 | hits on page: 40
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for KL53758: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for RA73981: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for EJ96142: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for HE39793: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for DD83263: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for SW21472: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for EY57880: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for ZN56944: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for HX50025: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for DH53723: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for RD62823: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for ZG72967: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for UH00217: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for EU75132: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for JY01361: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for FK09845: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for EB31921: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for DJ63605: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: US61346
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for TC61218: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for PP72448: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-30 06:37:32 [auto1.be] INFO: Scrape type for EV21741: 0
2026-03-30 06:37:32 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-30 06:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:33 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1290 | hits on page: 40
2026-03-30 06:37:33 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-30 06:37:33 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-30 06:37:33 [auto1.be] INFO: Scrape type for BZ95673: 0
2026-03-30 06:37:33 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-30 06:37:33 [auto1.be] INFO: Scrape type for AG16412: 0
2026-03-30 06:37:33 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-30 06:37:33 [auto1.be] INFO: Scrape type for TM16327: 0
2026-03-30 06:37:33 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-30 06:37:33 [auto1.be] INFO: Scrape type for UC18604: 0
2026-03-30 06:37:33 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-30 06:37:34 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-30 06:37:34 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-30 06:37:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:35 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1290 | hits on page: 10
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-30 06:37:35 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-30 06:37:35 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-30 06:37:35 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-30 06:37:35 [auto1.be] INFO: Scrape type for AB98915: 2
2026-03-30 06:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-30 06:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b71501c-e35f-5284-9543-b5c40ad92f2c with scrape type 2
2026-03-30 06:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b71501c-e35f-5284-9543-b5c40ad92f2c with scrape type 2
2026-03-30 06:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b71501c-e35f-5284-9543-b5c40ad92f2c, identifier: AB98915
2026-03-30 06:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-30 06:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-30 06:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915 to the API
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:01Z',
 'fuel_type': 'diesel',
 'id': '4b71501c-e35f-5284-9543-b5c40ad92f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB98915',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 144079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Origin',
 'transmission': 'manual',
 'trim': 'Origin',
 'year': 2014}
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-30 06:37:35 [auto1.be] INFO: Saving data for AB98915: {'auction_closing_time': 1774886161.0, 'created_time': 1774298302.753147, 'last_price_update_time': 1774852655.727769}
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB98915') HTTP/1.1" 204 0
2026-03-30 06:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-30 06:37:35 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-30 06:37:35 [auto1.be] INFO: Scrape type for XL09418: 2
2026-03-30 06:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-30 06:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with scrape type 2
2026-03-30 06:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with scrape type 2
2026-03-30 06:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20d094a7-5388-5a8e-97d5-c729ff5bdc54, identifier: XL09418
2026-03-30 06:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-30 06:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-30 06:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418 to the API
2026-03-30 06:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:38Z',
 'fuel_type': 'diesel',
 'id': '20d094a7-5388-5a8e-97d5-c729ff5bdc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL09418',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 151368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 2,9t Authentique',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Authentique',
 'year': 2012}
2026-03-30 06:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-30 06:37:36 [auto1.be] INFO: Saving data for XL09418: {'auction_closing_time': 1774885298.0, 'created_time': 1774298275.949361, 'last_price_update_time': 1774852656.196758}
2026-03-30 06:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL09418') HTTP/1.1" 204 0
2026-03-30 06:37:36 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-30 06:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:37:36 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1290 | hits on page: 0
2026-03-30 06:37:36 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 06:37:36 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-30 06:37:36 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 3}
2026-03-30 06:37:37 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (229 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-30T06_35_00.jl
2026-03-30 06:37:37 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 153854,
 'downloader/request_count': 66,
 'downloader/request_method_count/GET': 30,
 'downloader/request_method_count/POST': 36,
 'downloader/response_bytes': 7436230,
 'downloader/response_count': 66,
 'downloader/response_status_count/200': 66,
 'dupefilter/filtered': 4,
 'elapsed_time_seconds': 150.243707,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 6, 37, 37, 6709, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 229,
 'log_count/DEBUG': 3254,
 'log_count/INFO': 4084,
 'memusage/max': 173469696,
 'memusage/startup': 149897216,
 'photo_download_count': 20,
 'request_depth_max': 37,
 'response_received_count': 46,
 'scheduler/dequeued': 66,
 'scheduler/dequeued/memory': 66,
 'scheduler/enqueued': 66,
 'scheduler/enqueued/memory': 66,
 'scrape_type/batch_skipped': 666,
 'scrape_type/new': 4,
 'scrape_type/price_update': 225,
 'scrape_type/skipped': 431,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 46,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.8535913306531375,
 'scrapy-zyte-api/mean_response_seconds': 2.9498395551218772,
 'scrapy-zyte-api/processed': 46,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 46,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 45,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 46,
 'scrapy-zyte-api/request_args/httpRequestBody': 36,
 'scrapy-zyte-api/request_args/httpRequestMethod': 36,
 'scrapy-zyte-api/request_args/httpResponseBody': 46,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 46,
 'scrapy-zyte-api/request_args/sessionContext': 46,
 'scrapy-zyte-api/request_args/url': 46,
 'scrapy-zyte-api/status_codes/200': 46,
 'scrapy-zyte-api/success': 46,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1330,
 'source/total_available': 1290,
 'start_time': datetime.datetime(2026, 3, 30, 6, 35, 6, 763002, tzinfo=datetime.timezone.utc)}
2026-03-30 06:37:37 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 06:37:37 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb9ce282110>
2026-03-30 06:37:37 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb9ce3d3c90>