2026-03-28 06:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 06:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 06:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-28 06:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 06:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 06:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 06:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 06:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 06:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: c83de2460657dbcb
2026-03-28 06:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 06:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-28T06_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 06:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 06:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 06:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 06:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 06:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 06:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 06:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 06:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 06:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 06:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 06:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 06:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 06:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 06:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 06:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 06:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 06:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 06:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 06:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 06:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 06:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 06:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 06:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 06:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 06:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 06:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 06:35:17 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-28 06:35:17 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-28 06:35:17 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-28 06:35:17 [auto1.be] INFO: Scrape type for PX22691: 2
2026-03-28 06:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00d6fbc5-3097-5547-a3b1-b5e431c78195 with identifier: PX22691
2026-03-28 06:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00d6fbc5-3097-5547-a3b1-b5e431c78195 with scrape type 2
2026-03-28 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00d6fbc5-3097-5547-a3b1-b5e431c78195 with scrape type 2
2026-03-28 06:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00d6fbc5-3097-5547-a3b1-b5e431c78195, identifier: PX22691
2026-03-28 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00d6fbc5-3097-5547-a3b1-b5e431c78195 with identifier: PX22691
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 06:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00d6fbc5-3097-5547-a3b1-b5e431c78195 with identifier: PX22691
2026-03-28 06:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00d6fbc5-3097-5547-a3b1-b5e431c78195 with identifier: PX22691 to the API
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:16:26Z',
 'fuel_type': 'hybrid',
 'id': '00d6fbc5-3097-5547-a3b1-b5e431c78195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX22691',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 199518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-02',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-28 06:35:17 [auto1.be] INFO: Saving data for PX22691: {'auction_closing_time': 1774714586.0, 'created_time': 1774352341.058152, 'last_price_update_time': 1774679717.918696}
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PX22691') HTTP/1.1" 204 0
2026-03-28 06:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 06:35:17 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-28 06:35:17 [auto1.be] INFO: Scrape type for NE40925: 2
2026-03-28 06:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925
2026-03-28 06:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194879e1-6c5e-5f27-93c6-5c392dcee510 with scrape type 2
2026-03-28 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 194879e1-6c5e-5f27-93c6-5c392dcee510 with scrape type 2
2026-03-28 06:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 194879e1-6c5e-5f27-93c6-5c392dcee510, identifier: NE40925
2026-03-28 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925
2026-03-28 06:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 194879e1-6c5e-5f27-93c6-5c392dcee510 with identifier: NE40925 to the API
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:39:43Z',
 'fuel_type': 'diesel',
 'id': '194879e1-6c5e-5f27-93c6-5c392dcee510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE40925',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 312283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-01',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-28 06:35:18 [auto1.be] INFO: Saving data for NE40925: {'auction_closing_time': 1774715983.0, 'created_time': 1774557460.203722, 'last_price_update_time': 1774679718.498142}
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE40925') HTTP/1.1" 204 0
2026-03-28 06:35:18 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-28 06:35:18 [auto1.be] INFO: Scrape type for TU29469: 2
2026-03-28 06:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469
2026-03-28 06:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d47226-a315-5bb7-843c-777c4a00a5b5 with scrape type 2
2026-03-28 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d47226-a315-5bb7-843c-777c4a00a5b5 with scrape type 2
2026-03-28 06:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07d47226-a315-5bb7-843c-777c4a00a5b5, identifier: TU29469
2026-03-28 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 06:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469
2026-03-28 06:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07d47226-a315-5bb7-843c-777c4a00a5b5 with identifier: TU29469 to the API
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:38:55Z',
 'fuel_type': 'diesel',
 'id': '07d47226-a315-5bb7-843c-777c4a00a5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU29469',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 222315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Saving data for TU29469: {'auction_closing_time': 1774715935.0, 'created_time': 1774557418.378737, 'last_price_update_time': 1774679719.032084}
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU29469') HTTP/1.1" 204 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for BA79285: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for ZH21985: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for WX93406: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for TU23478: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for NH68811: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for SK39898: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for NY11434: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for XE88192: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for FU55081: 0
2026-03-28 06:35:19 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-28 06:35:19 [auto1.be] INFO: Scrape type for RB14392: 0
2026-03-28 06:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:21 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for PX22691: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for BA79285: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for ZH21985: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for WX93406: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for TU23478: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for NH68811: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for SK39898: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for NY11434: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for XE88192: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for FU55081: 0
2026-03-28 06:35:21 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-28 06:35:21 [auto1.be] INFO: Scrape type for RB14392: 0
2026-03-28 06:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:23 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for MY55708: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for XK15851: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA93870%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for TA93870: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF06459%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for JF06459: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ99747%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for PZ99747: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB53896%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for TB53896: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL30549%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for PL30549: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS47676%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for KS47676: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU28222%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for KU28222: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN33262%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for LN33262: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC85996%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for XC85996: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-28 06:35:23 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-28 06:35:23 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-28 06:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:24 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:24 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-28 06:35:24 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-28 06:35:24 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-28 06:35:24 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-28 06:35:24 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 06:35:24 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ92638%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for EZ92638: 2
2026-03-28 06:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 983fddc3-91a3-5a02-8fc6-1018cf9e8b07 with identifier: EZ92638
2026-03-28 06:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 983fddc3-91a3-5a02-8fc6-1018cf9e8b07 with scrape type 2
2026-03-28 06:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 983fddc3-91a3-5a02-8fc6-1018cf9e8b07 with scrape type 2
2026-03-28 06:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 983fddc3-91a3-5a02-8fc6-1018cf9e8b07, identifier: EZ92638
2026-03-28 06:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 983fddc3-91a3-5a02-8fc6-1018cf9e8b07 with identifier: EZ92638
2026-03-28 06:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 983fddc3-91a3-5a02-8fc6-1018cf9e8b07 with identifier: EZ92638
2026-03-28 06:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 983fddc3-91a3-5a02-8fc6-1018cf9e8b07 with identifier: EZ92638 to the API
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:36:43Z',
 'fuel_type': 'diesel',
 'id': '983fddc3-91a3-5a02-8fc6-1018cf9e8b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ92638',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 68514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-16',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Trend',
 'transmission': 'manual',
 'trim': '320 L2 Tourneo Trend',
 'year': 2023}
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ92638%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Saving data for EZ92638: {'auction_closing_time': 1774715803.0, 'created_time': 1774352275.136053, 'last_price_update_time': 1774679725.610575}
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ92638') HTTP/1.1" 204 0
2026-03-28 06:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68139%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for GM68139: 0
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 06:35:25 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-28 06:35:25 [auto1.be] INFO: Scrape type for LK25886: 2
2026-03-28 06:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-28 06:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with scrape type 2
2026-03-28 06:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with scrape type 2
2026-03-28 06:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71e014ce-426b-58c5-ae20-9af7a54bf9b3, identifier: LK25886
2026-03-28 06:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 06:35:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 06:35:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-28 06:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886 to the API
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 401,
 'expiration_date': '2026-03-28T16:35:47Z',
 'fuel_type': 'petrol',
 'id': '71e014ce-426b-58c5-ae20-9af7a54bf9b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK25886',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Ram 1500',
 'odometer': 183575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'Dodge Ram 1500 5.7 V8 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2017}
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Saving data for LK25886: {'auction_closing_time': 1774715747.0, 'created_time': 1774298167.967428, 'last_price_update_time': 1774679726.446231}
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK25886') HTTP/1.1" 204 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56450%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for CW56450: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44926%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for UA44926: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for YS75558: 0
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-28 06:35:26 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ37303%27 HTTP/1.1" 200 None
2026-03-28 06:35:26 [auto1.be] INFO: Scrape type for PJ37303: 2
2026-03-28 06:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a83922a-09c9-56e9-89a2-6ef06c994c6e with identifier: PJ37303
2026-03-28 06:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a83922a-09c9-56e9-89a2-6ef06c994c6e with scrape type 2
2026-03-28 06:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a83922a-09c9-56e9-89a2-6ef06c994c6e with scrape type 2
2026-03-28 06:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a83922a-09c9-56e9-89a2-6ef06c994c6e, identifier: PJ37303
2026-03-28 06:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a83922a-09c9-56e9-89a2-6ef06c994c6e with identifier: PJ37303
2026-03-28 06:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a83922a-09c9-56e9-89a2-6ef06c994c6e with identifier: PJ37303
2026-03-28 06:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a83922a-09c9-56e9-89a2-6ef06c994c6e with identifier: PJ37303 to the API
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:37:51Z',
 'fuel_type': 'hybrid',
 'id': '0a83922a-09c9-56e9-89a2-6ef06c994c6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ37303',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 133002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-01',
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid Dynamic Business',
 'transmission': 'automatic',
 'trim': 'Dynamic Business',
 'year': 2020}
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ37303%27 HTTP/1.1" 200 None
2026-03-28 06:35:27 [auto1.be] INFO: Saving data for PJ37303: {'auction_closing_time': 1774715871.0, 'created_time': 1773131811.073065, 'last_price_update_time': 1774679727.048296}
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ37303') HTTP/1.1" 204 0
2026-03-28 06:35:27 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-28 06:35:27 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-28 06:35:27 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-28 06:35:27 [auto1.be] INFO: Scrape type for SN78128: 2
2026-03-28 06:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-28 06:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e50a49-ca63-5701-9f1e-73ae9e786a27 with scrape type 2
2026-03-28 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e50a49-ca63-5701-9f1e-73ae9e786a27 with scrape type 2
2026-03-28 06:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46e50a49-ca63-5701-9f1e-73ae9e786a27, identifier: SN78128
2026-03-28 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-28 06:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-28 06:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128 to the API
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:57:00Z',
 'fuel_type': 'diesel',
 'id': '46e50a49-ca63-5701-9f1e-73ae9e786a27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN78128',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 158900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-04',
 'seller_name': None,
 'title': 'Toyota ProAce 1.6 D-4D L1H1 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 Kasten',
 'year': 2016}
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-28 06:35:27 [auto1.be] INFO: Saving data for SN78128: {'auction_closing_time': 1774717020.0, 'created_time': 1774557436.84309, 'last_price_update_time': 1774679727.55564}
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN78128') HTTP/1.1" 204 0
2026-03-28 06:35:27 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 06:35:27 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-28 06:35:27 [auto1.be] INFO: Scrape type for LM02594: 2
2026-03-28 06:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594
2026-03-28 06:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with scrape type 2
2026-03-28 06:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with scrape type 2
2026-03-28 06:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cea52d7-237f-58b6-b1b7-f8daf23514a3, identifier: LM02594
2026-03-28 06:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594
2026-03-28 06:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594
2026-03-28 06:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594 to the API
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:35Z',
 'fuel_type': 'diesel',
 'id': '8cea52d7-237f-58b6-b1b7-f8daf23514a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM02594',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-05',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2017}
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-28 06:35:27 [auto1.be] INFO: Saving data for LM02594: {'auction_closing_time': 1774713755.0, 'created_time': 1773384064.269949, 'last_price_update_time': 1774679727.979528}
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM02594') HTTP/1.1" 204 0
2026-03-28 06:35:27 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-28 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:28 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:28 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-28 06:35:28 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-28 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL48181%27 HTTP/1.1" 200 None
2026-03-28 06:35:28 [auto1.be] INFO: Scrape type for ZL48181: 0
2026-03-28 06:35:28 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS64524%27 HTTP/1.1" 200 None
2026-03-28 06:35:28 [auto1.be] INFO: Scrape type for WS64524: 0
2026-03-28 06:35:28 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 06:35:28 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-28 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-28 06:35:28 [auto1.be] INFO: Scrape type for MH10936: 2
2026-03-28 06:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936
2026-03-28 06:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b204a719-26b4-5425-83a5-bd1fb2b28a8c with scrape type 2
2026-03-28 06:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b204a719-26b4-5425-83a5-bd1fb2b28a8c with scrape type 2
2026-03-28 06:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b204a719-26b4-5425-83a5-bd1fb2b28a8c, identifier: MH10936
2026-03-28 06:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936
2026-03-28 06:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936
2026-03-28 06:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936 to the API
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:10:58Z',
 'fuel_type': 'diesel',
 'id': 'b204a719-26b4-5425-83a5-bd1fb2b28a8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH10936',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 86232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi SoChic',
 'transmission': 'automatic',
 'trim': 'SoChic',
 'year': 2020}
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-28 06:35:29 [auto1.be] INFO: Saving data for MH10936: {'auction_closing_time': 1774714258.0, 'created_time': 1773301742.481658, 'last_price_update_time': 1774679729.256175}
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MH10936') HTTP/1.1" 204 0
2026-03-28 06:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:29 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-28 06:35:29 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-28 06:35:29 [auto1.be] INFO: Scrape type for HA88594: 2
2026-03-28 06:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-28 06:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e262515-9741-5b52-9626-5ac56dd9ee03 with scrape type 2
2026-03-28 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e262515-9741-5b52-9626-5ac56dd9ee03 with scrape type 2
2026-03-28 06:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e262515-9741-5b52-9626-5ac56dd9ee03, identifier: HA88594
2026-03-28 06:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 06:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594
2026-03-28 06:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e262515-9741-5b52-9626-5ac56dd9ee03 with identifier: HA88594 to the API
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'hybrid',
 'id': '2e262515-9741-5b52-9626-5ac56dd9ee03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88594',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 37987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-28 06:35:29 [auto1.be] INFO: Saving data for HA88594: {'auction_closing_time': 1774716060.0, 'created_time': 1774557427.949412, 'last_price_update_time': 1774679729.842122}
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HA88594') HTTP/1.1" 204 0
2026-03-28 06:35:29 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-28 06:35:29 [auto1.be] INFO: Scrape type for PB88221: 2
2026-03-28 06:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221
2026-03-28 06:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5499533-a0b4-5f1c-8422-50e3069c4bf3 with scrape type 2
2026-03-28 06:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5499533-a0b4-5f1c-8422-50e3069c4bf3 with scrape type 2
2026-03-28 06:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5499533-a0b4-5f1c-8422-50e3069c4bf3, identifier: PB88221
2026-03-28 06:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221
2026-03-28 06:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221
2026-03-28 06:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221 to the API
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:56Z',
 'fuel_type': 'diesel',
 'id': 'e5499533-a0b4-5f1c-8422-50e3069c4bf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB88221',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 148931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Saving data for PB88221: {'auction_closing_time': 1774713776.0, 'created_time': 1773136626.050788, 'last_price_update_time': 1774679730.305012}
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB88221') HTTP/1.1" 204 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY53321%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for ZY53321: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN14983%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for AN14983: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY60433%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for KY60433: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for BY25509: 2
2026-03-28 06:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-28 06:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c87b4f-87da-5497-9e21-528da080e9ee with scrape type 2
2026-03-28 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c87b4f-87da-5497-9e21-528da080e9ee with scrape type 2
2026-03-28 06:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16c87b4f-87da-5497-9e21-528da080e9ee, identifier: BY25509
2026-03-28 06:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-28 06:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509
2026-03-28 06:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16c87b4f-87da-5497-9e21-528da080e9ee with identifier: BY25509 to the API
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:02:24Z',
 'fuel_type': 'hybrid',
 'id': '16c87b4f-87da-5497-9e21-528da080e9ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY25509',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 204135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300de T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2020}
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Saving data for BY25509: {'auction_closing_time': 1774713744.0, 'created_time': 1774557572.117998, 'last_price_update_time': 1774679730.770739}
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY25509') HTTP/1.1" 204 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV88346%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for YV88346: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX76756%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for SX76756: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN79459%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for UN79459: 0
2026-03-28 06:35:30 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD83049%27 HTTP/1.1" 200 None
2026-03-28 06:35:30 [auto1.be] INFO: Scrape type for RD83049: 2
2026-03-28 06:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6654a9cd-6940-5e20-97e7-915620754ed2 with identifier: RD83049
2026-03-28 06:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6654a9cd-6940-5e20-97e7-915620754ed2 with scrape type 2
2026-03-28 06:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6654a9cd-6940-5e20-97e7-915620754ed2 with scrape type 2
2026-03-28 06:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6654a9cd-6940-5e20-97e7-915620754ed2, identifier: RD83049
2026-03-28 06:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6654a9cd-6940-5e20-97e7-915620754ed2 with identifier: RD83049
2026-03-28 06:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6654a9cd-6940-5e20-97e7-915620754ed2 with identifier: RD83049
2026-03-28 06:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6654a9cd-6940-5e20-97e7-915620754ed2 with identifier: RD83049 to the API
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:04:26Z',
 'fuel_type': 'petrol',
 'id': '6654a9cd-6940-5e20-97e7-915620754ed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD83049',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 103506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD83049%27 HTTP/1.1" 200 None
2026-03-28 06:35:31 [auto1.be] INFO: Saving data for RD83049: {'auction_closing_time': 1774713866.0, 'created_time': 1774471326.373915, 'last_price_update_time': 1774679731.590787}
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD83049') HTTP/1.1" 204 0
2026-03-28 06:35:31 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64261%27 HTTP/1.1" 200 None
2026-03-28 06:35:31 [auto1.be] INFO: Scrape type for UE64261: 0
2026-03-28 06:35:31 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA02413%27 HTTP/1.1" 200 None
2026-03-28 06:35:31 [auto1.be] INFO: Scrape type for UA02413: 0
2026-03-28 06:35:31 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 06:35:31 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-28 06:35:31 [auto1.be] INFO: Scrape type for PL33803: 0
2026-03-28 06:35:31 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-28 06:35:31 [auto1.be] INFO: Scrape type for RS45224: 2
2026-03-28 06:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-28 06:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with scrape type 2
2026-03-28 06:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with scrape type 2
2026-03-28 06:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0, identifier: RS45224
2026-03-28 06:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-28 06:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224
2026-03-28 06:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcf8a864-bc50-59dc-a82d-e29ed5f9cef0 with identifier: RS45224 to the API
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:06:52Z',
 'fuel_type': 'diesel',
 'id': 'bcf8a864-bc50-59dc-a82d-e29ed5f9cef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS45224',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 155214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2015}
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Saving data for RS45224: {'auction_closing_time': 1774714012.0, 'created_time': 1774557400.059398, 'last_price_update_time': 1774679732.072688}
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS45224') HTTP/1.1" 204 0
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Scrape type for DK63787: 2
2026-03-28 06:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-28 06:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with scrape type 2
2026-03-28 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with scrape type 2
2026-03-28 06:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f638d8af-4889-5e8d-9674-aa20a8d4f5a8, identifier: DK63787
2026-03-28 06:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 06:35:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787
2026-03-28 06:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f638d8af-4889-5e8d-9674-aa20a8d4f5a8 with identifier: DK63787 to the API
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:00:06Z',
 'fuel_type': 'diesel',
 'id': 'f638d8af-4889-5e8d-9674-aa20a8d4f5a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK63787',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 85511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Active',
 'transmission': 'manual',
 'trim': 'Multijet Active',
 'year': 2010}
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Saving data for DK63787: {'auction_closing_time': 1774713606.0, 'created_time': 1774557489.451068, 'last_price_update_time': 1774679732.716491}
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK63787') HTTP/1.1" 204 0
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR59169%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Scrape type for GR59169: 0
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Scrape type for CD50328: 0
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU62289%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Scrape type for EU62289: 0
2026-03-28 06:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:32 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF40273%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Scrape type for YF40273: 0
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 06:35:32 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-28 06:35:32 [auto1.be] INFO: Scrape type for RH32729: 2
2026-03-28 06:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-28 06:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with scrape type 2
2026-03-28 06:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with scrape type 2
2026-03-28 06:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772, identifier: RH32729
2026-03-28 06:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-28 06:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729
2026-03-28 06:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb30bfc-ec38-501b-9be5-bbf1a07fb772 with identifier: RH32729 to the API
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:07:49Z',
 'fuel_type': 'petrol',
 'id': '5cb30bfc-ec38-501b-9be5-bbf1a07fb772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH32729',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 107330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Jaguar XE 20t R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2018}
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-28 06:35:33 [auto1.be] INFO: Saving data for RH32729: {'auction_closing_time': 1774714069.0, 'created_time': 1774557413.38859, 'last_price_update_time': 1774679733.31862}
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH32729') HTTP/1.1" 204 0
2026-03-28 06:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:33 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-28 06:35:33 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-28 06:35:33 [auto1.be] INFO: Scrape type for EL33380: 2
2026-03-28 06:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-28 06:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9750c431-3c7c-5715-be03-3746c097c497 with scrape type 2
2026-03-28 06:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9750c431-3c7c-5715-be03-3746c097c497 with scrape type 2
2026-03-28 06:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9750c431-3c7c-5715-be03-3746c097c497, identifier: EL33380
2026-03-28 06:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-28 06:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380
2026-03-28 06:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9750c431-3c7c-5715-be03-3746c097c497 with identifier: EL33380 to the API
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:31:34Z',
 'fuel_type': 'diesel',
 'id': '9750c431-3c7c-5715-be03-3746c097c497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL33380',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 244350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2013}
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-28 06:35:33 [auto1.be] INFO: Saving data for EL33380: {'auction_closing_time': 1774715494.0, 'created_time': 1774557425.860054, 'last_price_update_time': 1774679733.825292}
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL33380') HTTP/1.1" 204 0
2026-03-28 06:35:33 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 06:35:33 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-28 06:35:33 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-28 06:35:33 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH30418%27 HTTP/1.1" 200 None
2026-03-28 06:35:33 [auto1.be] INFO: Scrape type for KH30418: 2
2026-03-28 06:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd1c680-7891-573d-98ad-decfbedf0f90 with identifier: KH30418
2026-03-28 06:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd1c680-7891-573d-98ad-decfbedf0f90 with scrape type 2
2026-03-28 06:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfd1c680-7891-573d-98ad-decfbedf0f90 with scrape type 2
2026-03-28 06:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfd1c680-7891-573d-98ad-decfbedf0f90, identifier: KH30418
2026-03-28 06:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfd1c680-7891-573d-98ad-decfbedf0f90 with identifier: KH30418
2026-03-28 06:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfd1c680-7891-573d-98ad-decfbedf0f90 with identifier: KH30418
2026-03-28 06:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfd1c680-7891-573d-98ad-decfbedf0f90 with identifier: KH30418 to the API
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:54:25Z',
 'fuel_type': 'diesel',
 'id': 'cfd1c680-7891-573d-98ad-decfbedf0f90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH30418',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 170503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH30418%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Saving data for KH30418: {'auction_closing_time': 1774716865.0, 'created_time': 1773138045.568061, 'last_price_update_time': 1774679734.273045}
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH30418') HTTP/1.1" 204 0
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX63098%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Scrape type for KX63098: 0
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK71488%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Scrape type for CK71488: 0
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Scrape type for PJ31589: 2
2026-03-28 06:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-28 06:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with scrape type 2
2026-03-28 06:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with scrape type 2
2026-03-28 06:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb, identifier: PJ31589
2026-03-28 06:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-28 06:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589
2026-03-28 06:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f7d4129-2e6e-51ba-ab9d-98e84cffadfb with identifier: PJ31589 to the API
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:27:43Z',
 'fuel_type': 'diesel',
 'id': '6f7d4129-2e6e-51ba-ab9d-98e84cffadfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ31589',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 130985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.7 BLUE dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Saving data for PJ31589: {'auction_closing_time': 1774715263.0, 'created_time': 1774557420.949152, 'last_price_update_time': 1774679734.731105}
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ31589') HTTP/1.1" 204 0
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-28 06:35:34 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-28 06:35:34 [auto1.be] INFO: Scrape type for AB25804: 2
2026-03-28 06:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-28 06:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1645fa-fb66-50ea-8f1e-283d5e7d561b with scrape type 2
2026-03-28 06:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd1645fa-fb66-50ea-8f1e-283d5e7d561b with scrape type 2
2026-03-28 06:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd1645fa-fb66-50ea-8f1e-283d5e7d561b, identifier: AB25804
2026-03-28 06:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-28 06:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804
2026-03-28 06:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd1645fa-fb66-50ea-8f1e-283d5e7d561b with identifier: AB25804 to the API
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:09:45Z',
 'fuel_type': 'petrol',
 'id': 'bd1645fa-fb66-50ea-8f1e-283d5e7d561b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB25804',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-14',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2025}
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-28 06:35:35 [auto1.be] INFO: Saving data for AB25804: {'auction_closing_time': 1774714185.0, 'created_time': 1774557515.802979, 'last_price_update_time': 1774679735.270659}
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB25804') HTTP/1.1" 204 0
2026-03-28 06:35:35 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR44504%27 HTTP/1.1" 200 None
2026-03-28 06:35:35 [auto1.be] INFO: Scrape type for MR44504: 0
2026-03-28 06:35:35 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-28 06:35:35 [auto1.be] INFO: Scrape type for AD33980: 2
2026-03-28 06:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-28 06:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bdc7506-262d-593d-b4d9-706bf3948b06 with scrape type 2
2026-03-28 06:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bdc7506-262d-593d-b4d9-706bf3948b06 with scrape type 2
2026-03-28 06:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bdc7506-262d-593d-b4d9-706bf3948b06, identifier: AD33980
2026-03-28 06:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-28 06:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980
2026-03-28 06:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bdc7506-262d-593d-b4d9-706bf3948b06 with identifier: AD33980 to the API
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:09:36Z',
 'fuel_type': 'diesel',
 'id': '2bdc7506-262d-593d-b4d9-706bf3948b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD33980',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 154183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-28 06:35:35 [auto1.be] INFO: Saving data for AD33980: {'auction_closing_time': 1774714176.0, 'created_time': 1774557578.647518, 'last_price_update_time': 1774679735.706598}
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD33980') HTTP/1.1" 204 0
2026-03-28 06:35:35 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-28 06:35:35 [auto1.be] INFO: Scrape type for PY41942: 2
2026-03-28 06:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-28 06:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898f5281-625c-5310-aa5c-5592895a4d7a with scrape type 2
2026-03-28 06:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898f5281-625c-5310-aa5c-5592895a4d7a with scrape type 2
2026-03-28 06:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 898f5281-625c-5310-aa5c-5592895a4d7a, identifier: PY41942
2026-03-28 06:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-28 06:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942
2026-03-28 06:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 898f5281-625c-5310-aa5c-5592895a4d7a with identifier: PY41942 to the API
2026-03-28 06:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:00:31Z',
 'fuel_type': 'petrol',
 'id': '898f5281-625c-5310-aa5c-5592895a4d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY41942',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 92494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-08',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-28 06:35:36 [auto1.be] INFO: Saving data for PY41942: {'auction_closing_time': 1774713631.0, 'created_time': 1774557438.170411, 'last_price_update_time': 1774679736.11375}
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY41942') HTTP/1.1" 204 0
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU20603%27 HTTP/1.1" 200 None
2026-03-28 06:35:36 [auto1.be] INFO: Scrape type for BU20603: 0
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-28 06:35:36 [auto1.be] INFO: Scrape type for LT82149: 0
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF99667%27 HTTP/1.1" 200 None
2026-03-28 06:35:36 [auto1.be] INFO: Scrape type for VF99667: 0
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-28 06:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:36 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF90058%27 HTTP/1.1" 200 None
2026-03-28 06:35:36 [auto1.be] INFO: Scrape type for XF90058: 0
2026-03-28 06:35:36 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG55963%27 HTTP/1.1" 200 None
2026-03-28 06:35:36 [auto1.be] INFO: Scrape type for WG55963: 2
2026-03-28 06:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124e522a-4e65-5397-bd14-6ae6fe5b5526 with identifier: WG55963
2026-03-28 06:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124e522a-4e65-5397-bd14-6ae6fe5b5526 with scrape type 2
2026-03-28 06:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124e522a-4e65-5397-bd14-6ae6fe5b5526 with scrape type 2
2026-03-28 06:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 124e522a-4e65-5397-bd14-6ae6fe5b5526, identifier: WG55963
2026-03-28 06:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 124e522a-4e65-5397-bd14-6ae6fe5b5526 with identifier: WG55963
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 06:35:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 124e522a-4e65-5397-bd14-6ae6fe5b5526 with identifier: WG55963
2026-03-28 06:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 124e522a-4e65-5397-bd14-6ae6fe5b5526 with identifier: WG55963 to the API
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:57:54Z',
 'fuel_type': 'petrol',
 'id': '124e522a-4e65-5397-bd14-6ae6fe5b5526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG55963',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 30263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-03-28 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG55963%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Saving data for WG55963: {'auction_closing_time': 1774717074.0, 'created_time': 1774557565.954149, 'last_price_update_time': 1774679737.003082}
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG55963') HTTP/1.1" 204 0
2026-03-28 06:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK47918%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Scrape type for LK47918: 0
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT24920%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Scrape type for GT24920: 0
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK78813%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Scrape type for CK78813: 0
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL07479%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Scrape type for FL07479: 0
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV70453%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Scrape type for KV70453: 2
2026-03-28 06:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f28d54b2-4948-548f-a31a-d2e235e72884 with identifier: KV70453
2026-03-28 06:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28d54b2-4948-548f-a31a-d2e235e72884 with scrape type 2
2026-03-28 06:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f28d54b2-4948-548f-a31a-d2e235e72884 with scrape type 2
2026-03-28 06:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f28d54b2-4948-548f-a31a-d2e235e72884, identifier: KV70453
2026-03-28 06:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f28d54b2-4948-548f-a31a-d2e235e72884 with identifier: KV70453
2026-03-28 06:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f28d54b2-4948-548f-a31a-d2e235e72884 with identifier: KV70453
2026-03-28 06:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f28d54b2-4948-548f-a31a-d2e235e72884 with identifier: KV70453 to the API
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-28T16:37:41Z',
 'fuel_type': 'diesel',
 'id': 'f28d54b2-4948-548f-a31a-d2e235e72884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV70453',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 65137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-31',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV70453%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Saving data for KV70453: {'auction_closing_time': 1774715861.0, 'created_time': 1774471066.474412, 'last_price_update_time': 1774679737.625447}
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV70453') HTTP/1.1" 204 0
2026-03-28 06:35:37 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-28 06:35:37 [auto1.be] INFO: Scrape type for BV36868: 2
2026-03-28 06:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-28 06:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3744e4b7-4e40-5aa2-86da-4e72845af362 with scrape type 2
2026-03-28 06:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3744e4b7-4e40-5aa2-86da-4e72845af362 with scrape type 2
2026-03-28 06:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3744e4b7-4e40-5aa2-86da-4e72845af362, identifier: BV36868
2026-03-28 06:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-28 06:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868
2026-03-28 06:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3744e4b7-4e40-5aa2-86da-4e72845af362 with identifier: BV36868 to the API
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:28:14Z',
 'fuel_type': 'diesel',
 'id': '3744e4b7-4e40-5aa2-86da-4e72845af362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV36868',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2022}
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Saving data for BV36868: {'auction_closing_time': 1774715294.0, 'created_time': 1774557585.881787, 'last_price_update_time': 1774679738.045946}
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV36868') HTTP/1.1" 204 0
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Scrape type for CV26650: 2
2026-03-28 06:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-28 06:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with scrape type 2
2026-03-28 06:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with scrape type 2
2026-03-28 06:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d, identifier: CV26650
2026-03-28 06:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 06:35:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650
2026-03-28 06:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 053ddd54-7cb9-5f6c-9a40-f0f2df12153d with identifier: CV26650 to the API
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:28:55Z',
 'fuel_type': 'petrol',
 'id': '053ddd54-7cb9-5f6c-9a40-f0f2df12153d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV26650',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 123722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-03',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Saving data for CV26650: {'auction_closing_time': 1774715335.0, 'created_time': 1774557460.89487, 'last_price_update_time': 1774679738.559659}
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV26650') HTTP/1.1" 204 0
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT18330%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Scrape type for BT18330: 0
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF01400%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Scrape type for JF01400: 0
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL13165%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Scrape type for VL13165: 0
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Scrape type for WN85390: 0
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 06:35:38 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-28 06:35:38 [auto1.be] INFO: Scrape type for SP00889: 2
2026-03-28 06:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-28 06:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a4eaee-0660-5744-8f58-06aebbe7d68e with scrape type 2
2026-03-28 06:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a4eaee-0660-5744-8f58-06aebbe7d68e with scrape type 2
2026-03-28 06:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40a4eaee-0660-5744-8f58-06aebbe7d68e, identifier: SP00889
2026-03-28 06:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-28 06:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-28 06:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889 to the API
2026-03-28 06:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:42Z',
 'fuel_type': 'diesel',
 'id': '40a4eaee-0660-5744-8f58-06aebbe7d68e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP00889',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 145219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2018}
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-28 06:35:39 [auto1.be] INFO: Saving data for SP00889: {'auction_closing_time': 1774717182.0, 'created_time': 1774557543.095385, 'last_price_update_time': 1774679739.180494}
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP00889') HTTP/1.1" 204 0
2026-03-28 06:35:39 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV74957%27 HTTP/1.1" 200 None
2026-03-28 06:35:39 [auto1.be] INFO: Scrape type for KV74957: 2
2026-03-28 06:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193 with identifier: KV74957
2026-03-28 06:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193 with scrape type 2
2026-03-28 06:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193 with scrape type 2
2026-03-28 06:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193, identifier: KV74957
2026-03-28 06:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193 with identifier: KV74957
2026-03-28 06:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193 with identifier: KV74957
2026-03-28 06:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9040cd9a-ae5f-52ef-9b9d-456dbbdaf193 with identifier: KV74957 to the API
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:58:22Z',
 'fuel_type': 'diesel',
 'id': '9040cd9a-ae5f-52ef-9b9d-456dbbdaf193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV74957',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 506024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d extralang 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'extralang 4Matic BlueTEC Avantgarde',
 'year': 2017}
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV74957%27 HTTP/1.1" 200 None
2026-03-28 06:35:39 [auto1.be] INFO: Saving data for KV74957: {'auction_closing_time': 1774717102.0, 'created_time': 1773134217.344662, 'last_price_update_time': 1774679739.70108}
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV74957') HTTP/1.1" 204 0
2026-03-28 06:35:39 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-28 06:35:39 [auto1.be] INFO: Scrape type for YB46987: 2
2026-03-28 06:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987
2026-03-28 06:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d764ff5f-2957-538b-8342-eef22b8c96b0 with scrape type 2
2026-03-28 06:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d764ff5f-2957-538b-8342-eef22b8c96b0 with scrape type 2
2026-03-28 06:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d764ff5f-2957-538b-8342-eef22b8c96b0, identifier: YB46987
2026-03-28 06:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987
2026-03-28 06:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987
2026-03-28 06:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987 to the API
2026-03-28 06:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:21Z',
 'fuel_type': 'diesel',
 'id': 'd764ff5f-2957-538b-8342-eef22b8c96b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB46987',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 159882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-28 06:35:40 [auto1.be] INFO: Saving data for YB46987: {'auction_closing_time': 1774716741.0, 'created_time': 1773137045.358787, 'last_price_update_time': 1774679740.128493}
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB46987') HTTP/1.1" 204 0
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ37534%27 HTTP/1.1" 200 None
2026-03-28 06:35:40 [auto1.be] INFO: Scrape type for YJ37534: 0
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-28 06:35:40 [auto1.be] INFO: Scrape type for TY97185: 0
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-28 06:35:40 [auto1.be] INFO: Scrape type for ZX33086: 2
2026-03-28 06:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-28 06:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411cec9e-6db0-5a65-8b95-919189bfb052 with scrape type 2
2026-03-28 06:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411cec9e-6db0-5a65-8b95-919189bfb052 with scrape type 2
2026-03-28 06:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 411cec9e-6db0-5a65-8b95-919189bfb052, identifier: ZX33086
2026-03-28 06:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-28 06:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086
2026-03-28 06:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 411cec9e-6db0-5a65-8b95-919189bfb052 with identifier: ZX33086 to the API
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:11:05Z',
 'fuel_type': 'petrol',
 'id': '411cec9e-6db0-5a65-8b95-919189bfb052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX33086',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-28 06:35:40 [auto1.be] INFO: Saving data for ZX33086: {'auction_closing_time': 1774714265.0, 'created_time': 1774557403.37692, 'last_price_update_time': 1774679740.613465}
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX33086') HTTP/1.1" 204 0
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG04214%27 HTTP/1.1" 200 None
2026-03-28 06:35:40 [auto1.be] INFO: Scrape type for CG04214: 0
2026-03-28 06:35:40 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-28 06:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:41 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-28 06:35:41 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH51844%27 HTTP/1.1" 200 None
2026-03-28 06:35:41 [auto1.be] INFO: Scrape type for BH51844: 2
2026-03-28 06:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c83069-f03c-5579-a069-57c886205d93 with identifier: BH51844
2026-03-28 06:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c83069-f03c-5579-a069-57c886205d93 with scrape type 2
2026-03-28 06:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c83069-f03c-5579-a069-57c886205d93 with scrape type 2
2026-03-28 06:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d6c83069-f03c-5579-a069-57c886205d93, identifier: BH51844
2026-03-28 06:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d6c83069-f03c-5579-a069-57c886205d93 with identifier: BH51844
2026-03-28 06:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d6c83069-f03c-5579-a069-57c886205d93 with identifier: BH51844
2026-03-28 06:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d6c83069-f03c-5579-a069-57c886205d93 with identifier: BH51844 to the API
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:46:30Z',
 'fuel_type': 'hybrid',
 'id': 'd6c83069-f03c-5579-a069-57c886205d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH51844',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 141229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-06',
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH51844%27 HTTP/1.1" 200 None
2026-03-28 06:35:41 [auto1.be] INFO: Saving data for BH51844: {'auction_closing_time': 1774716390.0, 'created_time': 1773135681.485314, 'last_price_update_time': 1774679741.677005}
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BH51844') HTTP/1.1" 204 0
2026-03-28 06:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ18869%27 HTTP/1.1" 200 None
2026-03-28 06:35:41 [auto1.be] INFO: Scrape type for DZ18869: 0
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-28 06:35:41 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 06:35:41 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC57264%27 HTTP/1.1" 200 None
2026-03-28 06:35:41 [auto1.be] INFO: Scrape type for PC57264: 2
2026-03-28 06:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 463b7ea2-a9aa-57d5-966b-6b45bedab058 with identifier: PC57264
2026-03-28 06:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463b7ea2-a9aa-57d5-966b-6b45bedab058 with scrape type 2
2026-03-28 06:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 463b7ea2-a9aa-57d5-966b-6b45bedab058 with scrape type 2
2026-03-28 06:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 463b7ea2-a9aa-57d5-966b-6b45bedab058, identifier: PC57264
2026-03-28 06:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 463b7ea2-a9aa-57d5-966b-6b45bedab058 with identifier: PC57264
2026-03-28 06:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 463b7ea2-a9aa-57d5-966b-6b45bedab058 with identifier: PC57264
2026-03-28 06:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 463b7ea2-a9aa-57d5-966b-6b45bedab058 with identifier: PC57264 to the API
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:44:05Z',
 'fuel_type': 'petrol',
 'id': '463b7ea2-a9aa-57d5-966b-6b45bedab058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC57264',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 99415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2009}
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC57264%27 HTTP/1.1" 200 None
2026-03-28 06:35:42 [auto1.be] INFO: Saving data for PC57264: {'auction_closing_time': 1774716245.0, 'created_time': 1774471407.657389, 'last_price_update_time': 1774679742.220804}
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC57264') HTTP/1.1" 204 0
2026-03-28 06:35:42 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN83226%27 HTTP/1.1" 200 None
2026-03-28 06:35:42 [auto1.be] INFO: Scrape type for GN83226: 0
2026-03-28 06:35:42 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD12029%27 HTTP/1.1" 200 None
2026-03-28 06:35:42 [auto1.be] INFO: Scrape type for RD12029: 0
2026-03-28 06:35:42 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-28 06:35:42 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-28 06:35:42 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-28 06:35:42 [auto1.be] INFO: Scrape type for RW29034: 2
2026-03-28 06:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-28 06:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeb25f1-968c-59fd-a3b3-4e95be57668e with scrape type 2
2026-03-28 06:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeb25f1-968c-59fd-a3b3-4e95be57668e with scrape type 2
2026-03-28 06:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeb25f1-968c-59fd-a3b3-4e95be57668e, identifier: RW29034
2026-03-28 06:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-28 06:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-28 06:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034 to the API
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:41:51Z',
 'fuel_type': 'diesel',
 'id': 'deeb25f1-968c-59fd-a3b3-4e95be57668e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW29034',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 33539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-14',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 JTD Basis Kasten',
 'transmission': 'manual',
 'trim': 'Basis Kasten',
 'year': 2011}
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-28 06:35:42 [auto1.be] INFO: Saving data for RW29034: {'auction_closing_time': 1774716111.0, 'created_time': 1774557528.288267, 'last_price_update_time': 1774679742.673368}
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW29034') HTTP/1.1" 204 0
2026-03-28 06:35:42 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-28 06:35:42 [auto1.be] INFO: Scrape type for YR29884: 2
2026-03-28 06:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-28 06:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41970f1e-7c10-5801-9d46-d71c751dcf72 with scrape type 2
2026-03-28 06:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41970f1e-7c10-5801-9d46-d71c751dcf72 with scrape type 2
2026-03-28 06:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41970f1e-7c10-5801-9d46-d71c751dcf72, identifier: YR29884
2026-03-28 06:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-28 06:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884
2026-03-28 06:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41970f1e-7c10-5801-9d46-d71c751dcf72 with identifier: YR29884 to the API
2026-03-28 06:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:15Z',
 'fuel_type': 'diesel',
 'id': '41970f1e-7c10-5801-9d46-d71c751dcf72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR29884',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 217858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Saving data for YR29884: {'auction_closing_time': 1774714695.0, 'created_time': 1774557518.029565, 'last_price_update_time': 1774679743.178472}
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YR29884') HTTP/1.1" 204 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ07927%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for RZ07927: 2
2026-03-28 06:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12852e5d-d8b7-5658-83fd-706d2d809fa6 with identifier: RZ07927
2026-03-28 06:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12852e5d-d8b7-5658-83fd-706d2d809fa6 with scrape type 2
2026-03-28 06:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12852e5d-d8b7-5658-83fd-706d2d809fa6 with scrape type 2
2026-03-28 06:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12852e5d-d8b7-5658-83fd-706d2d809fa6, identifier: RZ07927
2026-03-28 06:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12852e5d-d8b7-5658-83fd-706d2d809fa6 with identifier: RZ07927
2026-03-28 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12852e5d-d8b7-5658-83fd-706d2d809fa6 with identifier: RZ07927
2026-03-28 06:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12852e5d-d8b7-5658-83fd-706d2d809fa6 with identifier: RZ07927 to the API
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:55:55Z',
 'fuel_type': 'diesel',
 'id': '12852e5d-d8b7-5658-83fd-706d2d809fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ07927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 280437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ07927%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Saving data for RZ07927: {'auction_closing_time': 1774716955.0, 'created_time': 1774471178.900861, 'last_price_update_time': 1774679743.672482}
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ07927') HTTP/1.1" 204 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR81556%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for LR81556: 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ84188%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for UJ84188: 0
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-28 06:35:43 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-28 06:35:43 [auto1.be] INFO: Scrape type for JR35998: 2
2026-03-28 06:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998
2026-03-28 06:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with scrape type 2
2026-03-28 06:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with scrape type 2
2026-03-28 06:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a, identifier: JR35998
2026-03-28 06:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998
2026-03-28 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998
2026-03-28 06:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998 to the API
2026-03-28 06:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:08:45Z',
 'fuel_type': 'diesel',
 'id': 'd1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR35998',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 200690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'BMW 7er 730d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-28 06:35:44 [auto1.be] INFO: Saving data for JR35998: {'auction_closing_time': 1774714125.0, 'created_time': 1773239529.755243, 'last_price_update_time': 1774679744.187988}
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JR35998') HTTP/1.1" 204 0
2026-03-28 06:35:44 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-28 06:35:44 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-28 06:35:44 [auto1.be] INFO: Scrape type for JV80966: 2
2026-03-28 06:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-28 06:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb7558e3-2cb4-5a8b-adea-0384455187d7 with scrape type 2
2026-03-28 06:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb7558e3-2cb4-5a8b-adea-0384455187d7 with scrape type 2
2026-03-28 06:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb7558e3-2cb4-5a8b-adea-0384455187d7, identifier: JV80966
2026-03-28 06:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-28 06:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-28 06:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966 to the API
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:54:19Z',
 'fuel_type': 'diesel',
 'id': 'fb7558e3-2cb4-5a8b-adea-0384455187d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV80966',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 118060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-26',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-28 06:35:44 [auto1.be] INFO: Saving data for JV80966: {'auction_closing_time': 1774716859.0, 'created_time': 1774557583.917276, 'last_price_update_time': 1774679744.869054}
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV80966') HTTP/1.1" 204 0
2026-03-28 06:35:44 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW50978%27 HTTP/1.1" 200 None
2026-03-28 06:35:44 [auto1.be] INFO: Scrape type for TW50978: 0
2026-03-28 06:35:44 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-28 06:35:44 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE86423%27 HTTP/1.1" 200 None
2026-03-28 06:35:44 [auto1.be] INFO: Scrape type for GE86423: 2
2026-03-28 06:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9368637f-006a-5c52-ae64-0810c2c6c385 with identifier: GE86423
2026-03-28 06:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9368637f-006a-5c52-ae64-0810c2c6c385 with scrape type 2
2026-03-28 06:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9368637f-006a-5c52-ae64-0810c2c6c385 with scrape type 2
2026-03-28 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9368637f-006a-5c52-ae64-0810c2c6c385, identifier: GE86423
2026-03-28 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9368637f-006a-5c52-ae64-0810c2c6c385 with identifier: GE86423
2026-03-28 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9368637f-006a-5c52-ae64-0810c2c6c385 with identifier: GE86423
2026-03-28 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9368637f-006a-5c52-ae64-0810c2c6c385 with identifier: GE86423 to the API
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:11Z',
 'fuel_type': 'hybrid',
 'id': '9368637f-006a-5c52-ae64-0810c2c6c385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE86423',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 176097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid GR Sport',
 'transmission': 'automatic',
 'trim': 'GR Sport',
 'year': 2021}
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE86423%27 HTTP/1.1" 200 None
2026-03-28 06:35:45 [auto1.be] INFO: Saving data for GE86423: {'auction_closing_time': 1774715891.0, 'created_time': 1773384239.385027, 'last_price_update_time': 1774679745.287376}
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GE86423') HTTP/1.1" 204 0
2026-03-28 06:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:45 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-28 06:35:45 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 06:35:45 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE10158%27 HTTP/1.1" 200 None
2026-03-28 06:35:45 [auto1.be] INFO: Scrape type for AE10158: 0
2026-03-28 06:35:45 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW03008%27 HTTP/1.1" 200 None
2026-03-28 06:35:45 [auto1.be] INFO: Scrape type for PW03008: 2
2026-03-28 06:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7daf6d8b-dd26-52cc-a51d-55cc567e5812 with identifier: PW03008
2026-03-28 06:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7daf6d8b-dd26-52cc-a51d-55cc567e5812 with scrape type 2
2026-03-28 06:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7daf6d8b-dd26-52cc-a51d-55cc567e5812 with scrape type 2
2026-03-28 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7daf6d8b-dd26-52cc-a51d-55cc567e5812, identifier: PW03008
2026-03-28 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7daf6d8b-dd26-52cc-a51d-55cc567e5812 with identifier: PW03008
2026-03-28 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7daf6d8b-dd26-52cc-a51d-55cc567e5812 with identifier: PW03008
2026-03-28 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7daf6d8b-dd26-52cc-a51d-55cc567e5812 with identifier: PW03008 to the API
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:09Z',
 'fuel_type': 'petrol',
 'id': '7daf6d8b-dd26-52cc-a51d-55cc567e5812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW03008',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 63521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW03008%27 HTTP/1.1" 200 None
2026-03-28 06:35:45 [auto1.be] INFO: Saving data for PW03008: {'auction_closing_time': 1774716969.0, 'created_time': 1773134516.862439, 'last_price_update_time': 1774679745.749957}
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PW03008') HTTP/1.1" 204 0
2026-03-28 06:35:45 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ92015%27 HTTP/1.1" 200 None
2026-03-28 06:35:45 [auto1.be] INFO: Scrape type for DJ92015: 0
2026-03-28 06:35:45 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM94904%27 HTTP/1.1" 200 None
2026-03-28 06:35:45 [auto1.be] INFO: Scrape type for RM94904: 2
2026-03-28 06:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff9d94d5-2138-5765-b633-adee64faee06 with identifier: RM94904
2026-03-28 06:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff9d94d5-2138-5765-b633-adee64faee06 with scrape type 2
2026-03-28 06:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff9d94d5-2138-5765-b633-adee64faee06 with scrape type 2
2026-03-28 06:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff9d94d5-2138-5765-b633-adee64faee06, identifier: RM94904
2026-03-28 06:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff9d94d5-2138-5765-b633-adee64faee06 with identifier: RM94904
2026-03-28 06:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff9d94d5-2138-5765-b633-adee64faee06 with identifier: RM94904
2026-03-28 06:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff9d94d5-2138-5765-b633-adee64faee06 with identifier: RM94904 to the API
2026-03-28 06:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:10Z',
 'fuel_type': 'diesel',
 'id': 'ff9d94d5-2138-5765-b633-adee64faee06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM94904',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 40279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Coast FWD',
 'transmission': 'automatic',
 'trim': 'Coast FWD',
 'year': 2023}
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM94904%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Saving data for RM94904: {'auction_closing_time': 1774714630.0, 'created_time': 1773383994.888967, 'last_price_update_time': 1774679746.19253}
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM94904') HTTP/1.1" 204 0
2026-03-28 06:35:46 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML32022%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for ML32022: 0
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC12895%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for YC12895: 0
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF46667%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for DF46667: 0
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW94232%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for GW94232: 0
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD21641%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for TD21641: 2
2026-03-28 06:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ddb1f3-5b62-58ab-9f65-695a7c5c742b with identifier: TD21641
2026-03-28 06:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32ddb1f3-5b62-58ab-9f65-695a7c5c742b with scrape type 2
2026-03-28 06:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32ddb1f3-5b62-58ab-9f65-695a7c5c742b with scrape type 2
2026-03-28 06:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 32ddb1f3-5b62-58ab-9f65-695a7c5c742b, identifier: TD21641
2026-03-28 06:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 32ddb1f3-5b62-58ab-9f65-695a7c5c742b with identifier: TD21641
2026-03-28 06:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 32ddb1f3-5b62-58ab-9f65-695a7c5c742b with identifier: TD21641
2026-03-28 06:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 32ddb1f3-5b62-58ab-9f65-695a7c5c742b with identifier: TD21641 to the API
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:22:45Z',
 'fuel_type': 'hybrid',
 'id': '32ddb1f3-5b62-58ab-9f65-695a7c5c742b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD21641',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 122041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD21641%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Saving data for TD21641: {'auction_closing_time': 1774714965.0, 'created_time': 1773224094.33813, 'last_price_update_time': 1774679746.800249}
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD21641') HTTP/1.1" 204 0
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB55394%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for LB55394: 0
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-28 06:35:46 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-28 06:35:46 [auto1.be] INFO: Scrape type for AX27110: 2
2026-03-28 06:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110
2026-03-28 06:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d2589a-531d-5ce5-ae01-0452f8a156ec with scrape type 2
2026-03-28 06:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0d2589a-531d-5ce5-ae01-0452f8a156ec with scrape type 2
2026-03-28 06:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0d2589a-531d-5ce5-ae01-0452f8a156ec, identifier: AX27110
2026-03-28 06:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110
2026-03-28 06:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110
2026-03-28 06:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110 to the API
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:29Z',
 'fuel_type': 'diesel',
 'id': 'c0d2589a-531d-5ce5-ae01-0452f8a156ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX27110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 116071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Saving data for AX27110: {'auction_closing_time': 1774717169.0, 'created_time': 1773136938.13352, 'last_price_update_time': 1774679747.271303}
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX27110') HTTP/1.1" 204 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB85934%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for GB85934: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR37992%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for PR37992: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for MD92482: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for HL89741: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER13199%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for ER13199: 0
2026-03-28 06:35:47 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM74317%27 HTTP/1.1" 200 None
2026-03-28 06:35:47 [auto1.be] INFO: Scrape type for FM74317: 2
2026-03-28 06:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd with identifier: FM74317
2026-03-28 06:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd with scrape type 2
2026-03-28 06:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd with scrape type 2
2026-03-28 06:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd, identifier: FM74317
2026-03-28 06:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd with identifier: FM74317
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 06:35:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd with identifier: FM74317
2026-03-28 06:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd with identifier: FM74317 to the API
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:03Z',
 'fuel_type': 'diesel',
 'id': '9f0da69a-95f5-5a03-b8cc-d2fad4ed00bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM74317',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 206905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-17',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
 'transmission': 'manual',
 'trim': 'Style blue 2WD',
 'year': 2016}
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM74317%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Saving data for FM74317: {'auction_closing_time': 1774716363.0, 'created_time': 1774557517.234082, 'last_price_update_time': 1774679748.013135}
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM74317') HTTP/1.1" 204 0
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN70818%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Scrape type for YN70818: 0
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR10172%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Scrape type for WR10172: 2
2026-03-28 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60b4f5d9-4002-5f8f-a430-012d37e144ea with identifier: WR10172
2026-03-28 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60b4f5d9-4002-5f8f-a430-012d37e144ea with scrape type 2
2026-03-28 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60b4f5d9-4002-5f8f-a430-012d37e144ea with scrape type 2
2026-03-28 06:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 60b4f5d9-4002-5f8f-a430-012d37e144ea, identifier: WR10172
2026-03-28 06:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 60b4f5d9-4002-5f8f-a430-012d37e144ea with identifier: WR10172
2026-03-28 06:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 60b4f5d9-4002-5f8f-a430-012d37e144ea with identifier: WR10172
2026-03-28 06:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 60b4f5d9-4002-5f8f-a430-012d37e144ea with identifier: WR10172 to the API
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:40:13Z',
 'fuel_type': 'petrol',
 'id': '60b4f5d9-4002-5f8f-a430-012d37e144ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR10172',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 157896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-21',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR10172%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Saving data for WR10172: {'auction_closing_time': 1774716013.0, 'created_time': 1774557514.505218, 'last_price_update_time': 1774679748.570489}
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WR10172') HTTP/1.1" 204 0
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ60295%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Scrape type for DZ60295: 0
2026-03-28 06:35:48 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-28 06:35:48 [auto1.be] INFO: Scrape type for TL07516: 2
2026-03-28 06:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-28 06:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d1b045-7053-5402-a147-86c043a03d45 with scrape type 2
2026-03-28 06:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d1b045-7053-5402-a147-86c043a03d45 with scrape type 2
2026-03-28 06:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64d1b045-7053-5402-a147-86c043a03d45, identifier: TL07516
2026-03-28 06:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-28 06:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-28 06:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516 to the API
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:45:26Z',
 'fuel_type': 'petrol',
 'id': '64d1b045-7053-5402-a147-86c043a03d45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL07516',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 126427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Saving data for TL07516: {'auction_closing_time': 1774716326.0, 'created_time': 1774557554.058786, 'last_price_update_time': 1774679749.021447}
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL07516') HTTP/1.1" 204 0
2026-03-28 06:35:49 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Scrape type for GW87029: 0
2026-03-28 06:35:49 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL95058%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Scrape type for YL95058: 0
2026-03-28 06:35:49 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-28 06:35:49 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY14138%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Scrape type for BY14138: 2
2026-03-28 06:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 568dae96-1860-52e8-9358-63d60e2e0481 with identifier: BY14138
2026-03-28 06:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 568dae96-1860-52e8-9358-63d60e2e0481 with scrape type 2
2026-03-28 06:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 568dae96-1860-52e8-9358-63d60e2e0481 with scrape type 2
2026-03-28 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 568dae96-1860-52e8-9358-63d60e2e0481, identifier: BY14138
2026-03-28 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 568dae96-1860-52e8-9358-63d60e2e0481 with identifier: BY14138
2026-03-28 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 568dae96-1860-52e8-9358-63d60e2e0481 with identifier: BY14138
2026-03-28 06:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 568dae96-1860-52e8-9358-63d60e2e0481 with identifier: BY14138 to the API
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:55:03Z',
 'fuel_type': 'diesel',
 'id': '568dae96-1860-52e8-9358-63d60e2e0481',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY14138',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 194364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Linje Svart',
 'transmission': 'automatic',
 'trim': 'Linje Svart',
 'year': 2016}
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY14138%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Saving data for BY14138: {'auction_closing_time': 1774716903.0, 'created_time': 1774471145.183452, 'last_price_update_time': 1774679749.548198}
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY14138') HTTP/1.1" 204 0
2026-03-28 06:35:49 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF17884%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Scrape type for EF17884: 2
2026-03-28 06:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fde9729-93e2-5868-b525-aa73b0a5f244 with identifier: EF17884
2026-03-28 06:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fde9729-93e2-5868-b525-aa73b0a5f244 with scrape type 2
2026-03-28 06:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fde9729-93e2-5868-b525-aa73b0a5f244 with scrape type 2
2026-03-28 06:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0fde9729-93e2-5868-b525-aa73b0a5f244, identifier: EF17884
2026-03-28 06:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0fde9729-93e2-5868-b525-aa73b0a5f244 with identifier: EF17884
2026-03-28 06:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0fde9729-93e2-5868-b525-aa73b0a5f244 with identifier: EF17884
2026-03-28 06:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0fde9729-93e2-5868-b525-aa73b0a5f244 with identifier: EF17884 to the API
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:24:21Z',
 'fuel_type': 'diesel',
 'id': '0fde9729-93e2-5868-b525-aa73b0a5f244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF17884',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 266244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-02',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF17884%27 HTTP/1.1" 200 None
2026-03-28 06:35:49 [auto1.be] INFO: Saving data for EF17884: {'auction_closing_time': 1774715061.0, 'created_time': 1774557524.3246, 'last_price_update_time': 1774679749.953231}
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EF17884') HTTP/1.1" 204 0
2026-03-28 06:35:49 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 06:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:50 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:50 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-28 06:35:50 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-28 06:35:50 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-28 06:35:50 [auto1.be] INFO: Scrape type for KG55279: 2
2026-03-28 06:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-28 06:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8960310-7c5d-51c0-b05a-5286b81cbb22 with scrape type 2
2026-03-28 06:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8960310-7c5d-51c0-b05a-5286b81cbb22 with scrape type 2
2026-03-28 06:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8960310-7c5d-51c0-b05a-5286b81cbb22, identifier: KG55279
2026-03-28 06:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-28 06:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-28 06:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279 to the API
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:55:57Z',
 'fuel_type': 'petrol',
 'id': 'd8960310-7c5d-51c0-b05a-5286b81cbb22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG55279',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 107056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-28',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-28 06:35:50 [auto1.be] INFO: Saving data for KG55279: {'auction_closing_time': 1774716957.0, 'created_time': 1774557544.726713, 'last_price_update_time': 1774679750.507817}
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG55279') HTTP/1.1" 204 0
2026-03-28 06:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:50 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-28 06:35:50 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN66713%27 HTTP/1.1" 200 None
2026-03-28 06:35:50 [auto1.be] INFO: Scrape type for CN66713: 0
2026-03-28 06:35:50 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-28 06:35:50 [auto1.be] INFO: Scrape type for VU16052: 2
2026-03-28 06:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-28 06:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with scrape type 2
2026-03-28 06:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with scrape type 2
2026-03-28 06:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e, identifier: VU16052
2026-03-28 06:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-28 06:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052
2026-03-28 06:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 262bea1c-b4eb-5202-a36b-4a2e9465aa0e with identifier: VU16052 to the API
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:23:51Z',
 'fuel_type': 'diesel',
 'id': '262bea1c-b4eb-5202-a36b-4a2e9465aa0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU16052',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 95545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 D250 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-28 06:35:50 [auto1.be] INFO: Saving data for VU16052: {'auction_closing_time': 1774715031.0, 'created_time': 1774557558.197452, 'last_price_update_time': 1774679750.941879}
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU16052') HTTP/1.1" 204 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ63633%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for EJ63633: 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for PR27183: 2
2026-03-28 06:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-28 06:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f65751a-a9b9-53be-b964-58a154fdbf52 with scrape type 2
2026-03-28 06:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f65751a-a9b9-53be-b964-58a154fdbf52 with scrape type 2
2026-03-28 06:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f65751a-a9b9-53be-b964-58a154fdbf52, identifier: PR27183
2026-03-28 06:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-28 06:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-28 06:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183 to the API
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:54:13Z',
 'fuel_type': 'diesel',
 'id': '5f65751a-a9b9-53be-b964-58a154fdbf52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR27183',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 162236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-06',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2016}
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Saving data for PR27183: {'auction_closing_time': 1774716853.0, 'created_time': 1774557473.251058, 'last_price_update_time': 1774679751.475052}
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR27183') HTTP/1.1" 204 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18687%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for CV18687: 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for GF03232: 2
2026-03-28 06:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-28 06:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with scrape type 2
2026-03-28 06:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with scrape type 2
2026-03-28 06:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71, identifier: GF03232
2026-03-28 06:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-28 06:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232
2026-03-28 06:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14e2b49a-20f1-5b28-9d7f-68c6d5b2be71 with identifier: GF03232 to the API
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:42Z',
 'fuel_type': 'diesel',
 'id': '14e2b49a-20f1-5b28-9d7f-68c6d5b2be71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF03232',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 157258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-16',
 'seller_name': None,
 'title': 'BMW 3er 316d Première',
 'transmission': 'manual',
 'trim': 'Première',
 'year': 2010}
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Saving data for GF03232: {'auction_closing_time': 1774715022.0, 'created_time': 1774557539.585204, 'last_price_update_time': 1774679751.959316}
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF03232') HTTP/1.1" 204 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-28 06:35:51 [auto1.be] INFO: Scrape type for NA97131: 0
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-28 06:35:51 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Scrape type for UL72077: 2
2026-03-28 06:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-28 06:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114e7634-f28a-5234-9918-f2f9b147ffe8 with scrape type 2
2026-03-28 06:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 114e7634-f28a-5234-9918-f2f9b147ffe8 with scrape type 2
2026-03-28 06:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 114e7634-f28a-5234-9918-f2f9b147ffe8, identifier: UL72077
2026-03-28 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-28 06:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077
2026-03-28 06:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 114e7634-f28a-5234-9918-f2f9b147ffe8 with identifier: UL72077 to the API
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:15:23Z',
 'fuel_type': 'petrol',
 'id': '114e7634-f28a-5234-9918-f2f9b147ffe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL72077',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 50514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Saving data for UL72077: {'auction_closing_time': 1774714523.0, 'created_time': 1774557542.208735, 'last_price_update_time': 1774679752.4108}
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL72077') HTTP/1.1" 204 0
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Scrape type for SW90596: 2
2026-03-28 06:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-28 06:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with scrape type 2
2026-03-28 06:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with scrape type 2
2026-03-28 06:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6, identifier: SW90596
2026-03-28 06:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-28 06:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-28 06:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596 to the API
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:39Z',
 'fuel_type': 'diesel',
 'id': 'd7bd75cc-3f75-5907-b9e9-ffdf9172b0c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW90596',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'Q30',
 'odometer': 221519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Infiniti Q30 1.5 Diesel Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2018}
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Saving data for SW90596: {'auction_closing_time': 1774717059.0, 'created_time': 1774557515.519916, 'last_price_update_time': 1774679752.935673}
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW90596') HTTP/1.1" 204 0
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-28 06:35:52 [auto1.be] INFO: Scrape type for AM99393: 0
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 06:35:52 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-28 06:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY49769%27 HTTP/1.1" 200 None
2026-03-28 06:35:53 [auto1.be] INFO: Scrape type for XY49769: 0
2026-03-28 06:35:53 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX92013%27 HTTP/1.1" 200 None
2026-03-28 06:35:53 [auto1.be] INFO: Scrape type for CX92013: 2
2026-03-28 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1 with identifier: CX92013
2026-03-28 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1 with scrape type 2
2026-03-28 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1 with scrape type 2
2026-03-28 06:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1, identifier: CX92013
2026-03-28 06:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1 with identifier: CX92013
2026-03-28 06:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1 with identifier: CX92013
2026-03-28 06:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1 with identifier: CX92013 to the API
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:43:05Z',
 'fuel_type': 'diesel',
 'id': '12bdc1d1-0b61-5ab4-be25-b05d0ac71ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX92013',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 162707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Volvo C30 1.6 DRIVe Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2011}
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX92013%27 HTTP/1.1" 200 None
2026-03-28 06:35:53 [auto1.be] INFO: Saving data for CX92013: {'auction_closing_time': 1774716185.0, 'created_time': 1773224822.931253, 'last_price_update_time': 1774679753.416699}
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX92013') HTTP/1.1" 204 0
2026-03-28 06:35:53 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-28 06:35:53 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-28 06:35:53 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-28 06:35:53 [auto1.be] INFO: Scrape type for VW08902: 2
2026-03-28 06:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-28 06:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f4240f-d01b-514a-851b-e9a4f9711b5d with scrape type 2
2026-03-28 06:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f4240f-d01b-514a-851b-e9a4f9711b5d with scrape type 2
2026-03-28 06:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43f4240f-d01b-514a-851b-e9a4f9711b5d, identifier: VW08902
2026-03-28 06:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 06:35:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902
2026-03-28 06:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43f4240f-d01b-514a-851b-e9a4f9711b5d with identifier: VW08902 to the API
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:24:14Z',
 'fuel_type': 'gas',
 'id': '43f4240f-d01b-514a-851b-e9a4f9711b5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW08902',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 63942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-04',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Saving data for VW08902: {'auction_closing_time': 1774715054.0, 'created_time': 1774557488.841466, 'last_price_update_time': 1774679754.033352}
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW08902') HTTP/1.1" 204 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for YB34897: 0
2026-03-28 06:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:54 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB62754%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for CB62754: 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for KE03465: 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84534%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for BR84534: 0
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-28 06:35:54 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW31488%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Scrape type for ZW31488: 2
2026-03-28 06:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48facc20-674a-5628-bb53-72b29ad358e4 with identifier: ZW31488
2026-03-28 06:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48facc20-674a-5628-bb53-72b29ad358e4 with scrape type 2
2026-03-28 06:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48facc20-674a-5628-bb53-72b29ad358e4 with scrape type 2
2026-03-28 06:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48facc20-674a-5628-bb53-72b29ad358e4, identifier: ZW31488
2026-03-28 06:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48facc20-674a-5628-bb53-72b29ad358e4 with identifier: ZW31488
2026-03-28 06:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48facc20-674a-5628-bb53-72b29ad358e4 with identifier: ZW31488
2026-03-28 06:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48facc20-674a-5628-bb53-72b29ad358e4 with identifier: ZW31488 to the API
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:44:40Z',
 'fuel_type': 'diesel',
 'id': '48facc20-674a-5628-bb53-72b29ad358e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW31488',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 184821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW31488%27 HTTP/1.1" 200 None
2026-03-28 06:35:54 [auto1.be] INFO: Saving data for ZW31488: {'auction_closing_time': 1774716280.0, 'created_time': 1774471348.95755, 'last_price_update_time': 1774679754.974658}
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZW31488') HTTP/1.1" 204 0
2026-03-28 06:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE01185%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for JE01185: 2
2026-03-28 06:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c90c19c-97b4-5059-9fe7-7de239036692 with identifier: JE01185
2026-03-28 06:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c90c19c-97b4-5059-9fe7-7de239036692 with scrape type 2
2026-03-28 06:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c90c19c-97b4-5059-9fe7-7de239036692 with scrape type 2
2026-03-28 06:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c90c19c-97b4-5059-9fe7-7de239036692, identifier: JE01185
2026-03-28 06:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c90c19c-97b4-5059-9fe7-7de239036692 with identifier: JE01185
2026-03-28 06:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c90c19c-97b4-5059-9fe7-7de239036692 with identifier: JE01185
2026-03-28 06:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c90c19c-97b4-5059-9fe7-7de239036692 with identifier: JE01185 to the API
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:35:52Z',
 'fuel_type': 'petrol',
 'id': '5c90c19c-97b4-5059-9fe7-7de239036692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE01185',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 78231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-08',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE01185%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Saving data for JE01185: {'auction_closing_time': 1774715752.0, 'created_time': 1774471033.97006, 'last_price_update_time': 1774679755.458123}
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JE01185') HTTP/1.1" 204 0
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE95179%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for CE95179: 0
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for YW00445: 2
2026-03-28 06:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-28 06:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with scrape type 2
2026-03-28 06:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with scrape type 2
2026-03-28 06:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd, identifier: YW00445
2026-03-28 06:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-28 06:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-28 06:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445 to the API
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:59:07Z',
 'fuel_type': 'petrol',
 'id': 'ee789807-2656-5a8d-ab6c-7ecd3f0a44cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW00445',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 129627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Saving data for YW00445: {'auction_closing_time': 1774717147.0, 'created_time': 1774557576.594724, 'last_price_update_time': 1774679755.924132}
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW00445') HTTP/1.1" 204 0
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT01513%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for JT01513: 0
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-28 06:35:55 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-28 06:35:55 [auto1.be] INFO: Scrape type for UA44051: 2
2026-03-28 06:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-28 06:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with scrape type 2
2026-03-28 06:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with scrape type 2
2026-03-28 06:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e, identifier: UA44051
2026-03-28 06:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-28 06:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051
2026-03-28 06:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76a5cf51-2799-5d31-9ca8-53fa6bc4766e with identifier: UA44051 to the API
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:32Z',
 'fuel_type': 'diesel',
 'id': '76a5cf51-2799-5d31-9ca8-53fa6bc4766e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44051',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 162200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 300 K LKW',
 'transmission': 'manual',
 'trim': 'FT 300 K LKW',
 'year': 2008}
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Saving data for UA44051: {'auction_closing_time': 1774714052.0, 'created_time': 1774254987.486264, 'last_price_update_time': 1774679756.360963}
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA44051') HTTP/1.1" 204 0
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Scrape type for GS68920: 2
2026-03-28 06:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-28 06:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e83de13-45c4-53fa-9b3c-534652257f0b with scrape type 2
2026-03-28 06:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e83de13-45c4-53fa-9b3c-534652257f0b with scrape type 2
2026-03-28 06:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e83de13-45c4-53fa-9b3c-534652257f0b, identifier: GS68920
2026-03-28 06:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-28 06:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920
2026-03-28 06:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e83de13-45c4-53fa-9b3c-534652257f0b with identifier: GS68920 to the API
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:47Z',
 'fuel_type': 'diesel',
 'id': '0e83de13-45c4-53fa-9b3c-534652257f0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS68920',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 293419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline',
 'transmission': 'manual',
 'trim': 'Maxi Trendline',
 'year': 2014}
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Saving data for GS68920: {'auction_closing_time': 1774714247.0, 'created_time': 1774557442.016866, 'last_price_update_time': 1774679756.89204}
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS68920') HTTP/1.1" 204 0
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Scrape type for CP45384: 0
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-28 06:35:56 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-28 06:35:56 [auto1.be] INFO: Scrape type for NK28391: 2
2026-03-28 06:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-28 06:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with scrape type 2
2026-03-28 06:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with scrape type 2
2026-03-28 06:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c, identifier: NK28391
2026-03-28 06:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-28 06:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391
2026-03-28 06:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f79b16c6-f2b0-5b80-94d2-ade444ee2d3c with identifier: NK28391 to the API
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:12Z',
 'fuel_type': 'diesel',
 'id': 'f79b16c6-f2b0-5b80-94d2-ade444ee2d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK28391',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 144167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Renault Laguna 1.5 dCi Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2014}
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-28 06:35:57 [auto1.be] INFO: Saving data for NK28391: {'auction_closing_time': 1774714692.0, 'created_time': 1774557526.094866, 'last_price_update_time': 1774679757.361076}
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK28391') HTTP/1.1" 204 0
2026-03-28 06:35:57 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW00167%27 HTTP/1.1" 200 None
2026-03-28 06:35:57 [auto1.be] INFO: Scrape type for CW00167: 0
2026-03-28 06:35:57 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-28 06:35:57 [auto1.be] INFO: Scrape type for BH52169: 0
2026-03-28 06:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:35:58 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1663 | hits on page: 40
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG88652%27 HTTP/1.1" 200 None
2026-03-28 06:35:58 [auto1.be] INFO: Scrape type for NG88652: 0
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP41015%27 HTTP/1.1" 200 None
2026-03-28 06:35:58 [auto1.be] INFO: Scrape type for NP41015: 0
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-28 06:35:58 [auto1.be] INFO: Scrape type for YM99739: 2
2026-03-28 06:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-28 06:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with scrape type 2
2026-03-28 06:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with scrape type 2
2026-03-28 06:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f8f74be6-f3a6-59bd-bb5e-569e69a5af36, identifier: YM99739
2026-03-28 06:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-28 06:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739
2026-03-28 06:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f8f74be6-f3a6-59bd-bb5e-569e69a5af36 with identifier: YM99739 to the API
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:22:58Z',
 'fuel_type': 'diesel',
 'id': 'f8f74be6-f3a6-59bd-bb5e-569e69a5af36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM99739',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 134202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-28 06:35:58 [auto1.be] INFO: Saving data for YM99739: {'auction_closing_time': 1774714978.0, 'created_time': 1774557577.075723, 'last_price_update_time': 1774679758.639013}
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM99739') HTTP/1.1" 204 0
2026-03-28 06:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-28 06:35:58 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 06:35:58 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-28 06:35:58 [auto1.be] INFO: Scrape type for TX28125: 2
2026-03-28 06:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125
2026-03-28 06:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609d2776-636a-505a-99b8-40bf6797ed97 with scrape type 2
2026-03-28 06:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609d2776-636a-505a-99b8-40bf6797ed97 with scrape type 2
2026-03-28 06:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 609d2776-636a-505a-99b8-40bf6797ed97, identifier: TX28125
2026-03-28 06:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125
2026-03-28 06:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125
2026-03-28 06:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125 to the API
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:16Z',
 'fuel_type': 'diesel',
 'id': '609d2776-636a-505a-99b8-40bf6797ed97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX28125',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 56389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2014}
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Saving data for TX28125: {'auction_closing_time': 1774714336.0, 'created_time': 1774039045.343658, 'last_price_update_time': 1774679759.075915}
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX28125') HTTP/1.1" 204 0
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ92859%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Scrape type for SJ92859: 0
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL08078%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Scrape type for SL08078: 0
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB55358%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Scrape type for RB55358: 2
2026-03-28 06:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe13200-cf8f-59b2-b1dc-46425df406fe with identifier: RB55358
2026-03-28 06:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe13200-cf8f-59b2-b1dc-46425df406fe with scrape type 2
2026-03-28 06:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe13200-cf8f-59b2-b1dc-46425df406fe with scrape type 2
2026-03-28 06:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1fe13200-cf8f-59b2-b1dc-46425df406fe, identifier: RB55358
2026-03-28 06:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1fe13200-cf8f-59b2-b1dc-46425df406fe with identifier: RB55358
2026-03-28 06:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1fe13200-cf8f-59b2-b1dc-46425df406fe with identifier: RB55358
2026-03-28 06:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1fe13200-cf8f-59b2-b1dc-46425df406fe with identifier: RB55358 to the API
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'petrol',
 'id': '1fe13200-cf8f-59b2-b1dc-46425df406fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB55358',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 103636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Volkswagen Arteon 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2018}
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB55358%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Saving data for RB55358: {'auction_closing_time': 1774714217.0, 'created_time': 1774557575.780847, 'last_price_update_time': 1774679759.612778}
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB55358') HTTP/1.1" 204 0
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49722%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Scrape type for TE49722: 0
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 06:35:59 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU36315%27 HTTP/1.1" 200 None
2026-03-28 06:35:59 [auto1.be] INFO: Scrape type for PU36315: 2
2026-03-28 06:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d28c0d-5026-5e2c-8023-95ba48ea65d8 with identifier: PU36315
2026-03-28 06:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d28c0d-5026-5e2c-8023-95ba48ea65d8 with scrape type 2
2026-03-28 06:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08d28c0d-5026-5e2c-8023-95ba48ea65d8 with scrape type 2
2026-03-28 06:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 08d28c0d-5026-5e2c-8023-95ba48ea65d8, identifier: PU36315
2026-03-28 06:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 08d28c0d-5026-5e2c-8023-95ba48ea65d8 with identifier: PU36315
2026-03-28 06:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 08d28c0d-5026-5e2c-8023-95ba48ea65d8 with identifier: PU36315
2026-03-28 06:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 08d28c0d-5026-5e2c-8023-95ba48ea65d8 with identifier: PU36315 to the API
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:06:32Z',
 'fuel_type': 'hybrid',
 'id': '08d28c0d-5026-5e2c-8023-95ba48ea65d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU36315',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 46033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-17',
 'seller_name': None,
 'title': 'Renault Austral 1.2 Hybrid E-Tech Iconic Esprit Alpine',
 'transmission': 'automatic',
 'trim': 'Iconic Esprit Alpine',
 'year': 2023}
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU36315%27 HTTP/1.1" 200 None
2026-03-28 06:36:00 [auto1.be] INFO: Saving data for PU36315: {'auction_closing_time': 1774713992.0, 'created_time': 1774557530.839584, 'last_price_update_time': 1774679760.08345}
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PU36315') HTTP/1.1" 204 0
2026-03-28 06:36:00 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN37079%27 HTTP/1.1" 200 None
2026-03-28 06:36:00 [auto1.be] INFO: Scrape type for NN37079: 0
2026-03-28 06:36:00 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-28 06:36:00 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-28 06:36:00 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-28 06:36:00 [auto1.be] INFO: Scrape type for UB84637: 2
2026-03-28 06:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-28 06:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68da693b-5610-5786-addd-9fe7fcbc7473 with scrape type 2
2026-03-28 06:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68da693b-5610-5786-addd-9fe7fcbc7473 with scrape type 2
2026-03-28 06:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 68da693b-5610-5786-addd-9fe7fcbc7473, identifier: UB84637
2026-03-28 06:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-28 06:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-28 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637 to the API
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-28T16:42:44Z',
 'fuel_type': 'diesel',
 'id': '68da693b-5610-5786-addd-9fe7fcbc7473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84637',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 49845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 2.0 CDTI Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2021}
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-28 06:36:00 [auto1.be] INFO: Saving data for UB84637: {'auction_closing_time': 1774716164.0, 'created_time': 1774557581.440424, 'last_price_update_time': 1774679760.650562}
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB84637') HTTP/1.1" 204 0
2026-03-28 06:36:00 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44217%27 HTTP/1.1" 200 None
2026-03-28 06:36:00 [auto1.be] INFO: Scrape type for WZ44217: 2
2026-03-28 06:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e631d616-926b-5866-a1a0-182ca85cba78 with identifier: WZ44217
2026-03-28 06:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e631d616-926b-5866-a1a0-182ca85cba78 with scrape type 2
2026-03-28 06:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e631d616-926b-5866-a1a0-182ca85cba78 with scrape type 2
2026-03-28 06:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e631d616-926b-5866-a1a0-182ca85cba78, identifier: WZ44217
2026-03-28 06:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e631d616-926b-5866-a1a0-182ca85cba78 with identifier: WZ44217
2026-03-28 06:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e631d616-926b-5866-a1a0-182ca85cba78 with identifier: WZ44217
2026-03-28 06:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e631d616-926b-5866-a1a0-182ca85cba78 with identifier: WZ44217 to the API
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:44:13Z',
 'fuel_type': 'petrol',
 'id': 'e631d616-926b-5866-a1a0-182ca85cba78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ44217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 80423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2020}
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44217%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Saving data for WZ44217: {'auction_closing_time': 1774716253.0, 'created_time': 1773132047.058232, 'last_price_update_time': 1774679761.120757}
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ44217') HTTP/1.1" 204 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR75863%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for NR75863: 2
2026-03-28 06:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02fe5827-14a8-5189-a9fd-6c1e7ba7441e with identifier: NR75863
2026-03-28 06:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02fe5827-14a8-5189-a9fd-6c1e7ba7441e with scrape type 2
2026-03-28 06:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02fe5827-14a8-5189-a9fd-6c1e7ba7441e with scrape type 2
2026-03-28 06:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 02fe5827-14a8-5189-a9fd-6c1e7ba7441e, identifier: NR75863
2026-03-28 06:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 02fe5827-14a8-5189-a9fd-6c1e7ba7441e with identifier: NR75863
2026-03-28 06:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 02fe5827-14a8-5189-a9fd-6c1e7ba7441e with identifier: NR75863
2026-03-28 06:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 02fe5827-14a8-5189-a9fd-6c1e7ba7441e with identifier: NR75863 to the API
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:12Z',
 'fuel_type': 'diesel',
 'id': '02fe5827-14a8-5189-a9fd-6c1e7ba7441e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR75863',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 78467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Business M',
 'transmission': 'manual',
 'trim': 'Business M',
 'year': 2020}
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR75863%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Saving data for NR75863: {'auction_closing_time': 1774713732.0, 'created_time': 1774471211.193731, 'last_price_update_time': 1774679761.547291}
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NR75863') HTTP/1.1" 204 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 06:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:01 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP19111%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for SP19111: 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF62281%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for BF62281: 0
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 06:36:01 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM06752%27 HTTP/1.1" 200 None
2026-03-28 06:36:01 [auto1.be] INFO: Scrape type for KM06752: 2
2026-03-28 06:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7565786f-4e41-54a6-8db6-8afa75b82f2b with identifier: KM06752
2026-03-28 06:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7565786f-4e41-54a6-8db6-8afa75b82f2b with scrape type 2
2026-03-28 06:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7565786f-4e41-54a6-8db6-8afa75b82f2b with scrape type 2
2026-03-28 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7565786f-4e41-54a6-8db6-8afa75b82f2b, identifier: KM06752
2026-03-28 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7565786f-4e41-54a6-8db6-8afa75b82f2b with identifier: KM06752
2026-03-28 06:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7565786f-4e41-54a6-8db6-8afa75b82f2b with identifier: KM06752
2026-03-28 06:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7565786f-4e41-54a6-8db6-8afa75b82f2b with identifier: KM06752 to the API
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:24:28Z',
 'fuel_type': 'diesel',
 'id': '7565786f-4e41-54a6-8db6-8afa75b82f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM06752',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 103101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM06752%27 HTTP/1.1" 200 None
2026-03-28 06:36:02 [auto1.be] INFO: Saving data for KM06752: {'auction_closing_time': 1774715068.0, 'created_time': 1774471153.604284, 'last_price_update_time': 1774679762.318869}
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM06752') HTTP/1.1" 204 0
2026-03-28 06:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ21578%27 HTTP/1.1" 200 None
2026-03-28 06:36:02 [auto1.be] INFO: Scrape type for KZ21578: 0
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-28 06:36:02 [auto1.be] INFO: Scrape type for SZ23077: 2
2026-03-28 06:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-28 06:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a43030-c3fb-5bec-8db5-534207806117 with scrape type 2
2026-03-28 06:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a43030-c3fb-5bec-8db5-534207806117 with scrape type 2
2026-03-28 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a43030-c3fb-5bec-8db5-534207806117, identifier: SZ23077
2026-03-28 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-28 06:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-28 06:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077 to the API
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:28:34Z',
 'fuel_type': 'petrol',
 'id': '96a43030-c3fb-5bec-8db5-534207806117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ23077',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 137354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-28 06:36:02 [auto1.be] INFO: Saving data for SZ23077: {'auction_closing_time': 1774715314.0, 'created_time': 1774557494.015964, 'last_price_update_time': 1774679762.845903}
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ23077') HTTP/1.1" 204 0
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ29729%27 HTTP/1.1" 200 None
2026-03-28 06:36:02 [auto1.be] INFO: Scrape type for PJ29729: 0
2026-03-28 06:36:02 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-28 06:36:02 [auto1.be] INFO: Scrape type for XT14784: 2
2026-03-28 06:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784
2026-03-28 06:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eda80a1-9a78-5977-a264-561930e8f9d0 with scrape type 2
2026-03-28 06:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eda80a1-9a78-5977-a264-561930e8f9d0 with scrape type 2
2026-03-28 06:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9eda80a1-9a78-5977-a264-561930e8f9d0, identifier: XT14784
2026-03-28 06:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784
2026-03-28 06:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784
2026-03-28 06:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784 to the API
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:50:49Z',
 'fuel_type': 'diesel',
 'id': '9eda80a1-9a78-5977-a264-561930e8f9d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT14784',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 165936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-28 06:36:03 [auto1.be] INFO: Saving data for XT14784: {'auction_closing_time': 1774716649.0, 'created_time': 1773384578.337419, 'last_price_update_time': 1774679763.285063}
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT14784') HTTP/1.1" 204 0
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY27857%27 HTTP/1.1" 200 None
2026-03-28 06:36:03 [auto1.be] INFO: Scrape type for ZY27857: 0
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX65189%27 HTTP/1.1" 200 None
2026-03-28 06:36:03 [auto1.be] INFO: Scrape type for NX65189: 0
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-28 06:36:03 [auto1.be] INFO: Scrape type for RX86056: 2
2026-03-28 06:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-28 06:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with scrape type 2
2026-03-28 06:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with scrape type 2
2026-03-28 06:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0, identifier: RX86056
2026-03-28 06:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-28 06:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056
2026-03-28 06:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d55adb9d-1855-5e89-b8b1-4016a3f0f3f0 with identifier: RX86056 to the API
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:08:18Z',
 'fuel_type': 'petrol',
 'id': 'd55adb9d-1855-5e89-b8b1-4016a3f0f3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX86056',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 205833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2021}
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-28 06:36:03 [auto1.be] INFO: Saving data for RX86056: {'auction_closing_time': 1774714098.0, 'created_time': 1774557579.795658, 'last_price_update_time': 1774679763.740459}
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX86056') HTTP/1.1" 204 0
2026-03-28 06:36:03 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-28 06:36:03 [auto1.be] INFO: Scrape type for LD32822: 2
2026-03-28 06:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-28 06:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266e880-6d4b-514d-ad90-cc5d371771a3 with scrape type 2
2026-03-28 06:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8266e880-6d4b-514d-ad90-cc5d371771a3 with scrape type 2
2026-03-28 06:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8266e880-6d4b-514d-ad90-cc5d371771a3, identifier: LD32822
2026-03-28 06:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-28 06:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-28 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822 to the API
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:19:48Z',
 'fuel_type': 'diesel',
 'id': '8266e880-6d4b-514d-ad90-cc5d371771a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD32822',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 131722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium TwinCab Edition L3',
 'transmission': 'automatic',
 'trim': 'Premium TwinCab Edition L3',
 'year': 2021}
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-28 06:36:04 [auto1.be] INFO: Saving data for LD32822: {'auction_closing_time': 1774714788.0, 'created_time': 1773384630.488052, 'last_price_update_time': 1774679764.237003}
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LD32822') HTTP/1.1" 204 0
2026-03-28 06:36:04 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-28 06:36:04 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN30379%27 HTTP/1.1" 200 None
2026-03-28 06:36:04 [auto1.be] INFO: Scrape type for WN30379: 2
2026-03-28 06:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f40ba984-1848-534d-802c-7fc2a77f0112 with identifier: WN30379
2026-03-28 06:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f40ba984-1848-534d-802c-7fc2a77f0112 with scrape type 2
2026-03-28 06:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f40ba984-1848-534d-802c-7fc2a77f0112 with scrape type 2
2026-03-28 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f40ba984-1848-534d-802c-7fc2a77f0112, identifier: WN30379
2026-03-28 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f40ba984-1848-534d-802c-7fc2a77f0112 with identifier: WN30379
2026-03-28 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f40ba984-1848-534d-802c-7fc2a77f0112 with identifier: WN30379
2026-03-28 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f40ba984-1848-534d-802c-7fc2a77f0112 with identifier: WN30379 to the API
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:34:11Z',
 'fuel_type': 'diesel',
 'id': 'f40ba984-1848-534d-802c-7fc2a77f0112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN30379',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 183052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Feel XL',
 'transmission': 'automatic',
 'trim': 'Feel XL',
 'year': 2019}
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN30379%27 HTTP/1.1" 200 None
2026-03-28 06:36:04 [auto1.be] INFO: Saving data for WN30379: {'auction_closing_time': 1774715651.0, 'created_time': 1773137250.616444, 'last_price_update_time': 1774679764.665957}
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN30379') HTTP/1.1" 204 0
2026-03-28 06:36:04 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-28 06:36:04 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 06:36:04 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-28 06:36:04 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-28 06:36:04 [auto1.be] INFO: Scrape type for AX26323: 2
2026-03-28 06:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323
2026-03-28 06:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3664efe9-0502-52bc-b175-242d1874d595 with scrape type 2
2026-03-28 06:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3664efe9-0502-52bc-b175-242d1874d595 with scrape type 2
2026-03-28 06:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3664efe9-0502-52bc-b175-242d1874d595, identifier: AX26323
2026-03-28 06:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323
2026-03-28 06:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323
2026-03-28 06:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323 to the API
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:44Z',
 'fuel_type': 'diesel',
 'id': '3664efe9-0502-52bc-b175-242d1874d595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX26323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 191767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-28 06:36:05 [auto1.be] INFO: Saving data for AX26323: {'auction_closing_time': 1774716644.0, 'created_time': 1773384248.836062, 'last_price_update_time': 1774679765.092173}
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX26323') HTTP/1.1" 204 0
2026-03-28 06:36:05 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-28 06:36:05 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-28 06:36:05 [auto1.be] INFO: Scrape type for DZ54195: 2
2026-03-28 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195
2026-03-28 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with scrape type 2
2026-03-28 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with scrape type 2
2026-03-28 06:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473, identifier: DZ54195
2026-03-28 06:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195
2026-03-28 06:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195
2026-03-28 06:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195 to the API
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-28T16:16:33Z',
 'fuel_type': 'hybrid',
 'id': '36c350ee-07e6-5d7a-a08c-c51ecf5f5473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ54195',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 33691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2021}
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-28 06:36:05 [auto1.be] INFO: Saving data for DZ54195: {'auction_closing_time': 1774714593.0, 'created_time': 1773228946.162087, 'last_price_update_time': 1774679765.509008}
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ54195') HTTP/1.1" 204 0
2026-03-28 06:36:05 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-28 06:36:05 [auto1.be] INFO: Scrape type for FA45415: 0
2026-03-28 06:36:05 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS89988%27 HTTP/1.1" 200 None
2026-03-28 06:36:05 [auto1.be] INFO: Scrape type for DS89988: 2
2026-03-28 06:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e47d8c94-cad4-589c-9b41-cea328baaee3 with identifier: DS89988
2026-03-28 06:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47d8c94-cad4-589c-9b41-cea328baaee3 with scrape type 2
2026-03-28 06:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e47d8c94-cad4-589c-9b41-cea328baaee3 with scrape type 2
2026-03-28 06:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e47d8c94-cad4-589c-9b41-cea328baaee3, identifier: DS89988
2026-03-28 06:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e47d8c94-cad4-589c-9b41-cea328baaee3 with identifier: DS89988
2026-03-28 06:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e47d8c94-cad4-589c-9b41-cea328baaee3 with identifier: DS89988
2026-03-28 06:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e47d8c94-cad4-589c-9b41-cea328baaee3 with identifier: DS89988 to the API
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:10:58Z',
 'fuel_type': 'diesel',
 'id': 'e47d8c94-cad4-589c-9b41-cea328baaee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS89988',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 80103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS89988%27 HTTP/1.1" 200 None
2026-03-28 06:36:05 [auto1.be] INFO: Saving data for DS89988: {'auction_closing_time': 1774714258.0, 'created_time': 1774557415.370036, 'last_price_update_time': 1774679765.920082}
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DS89988') HTTP/1.1" 204 0
2026-03-28 06:36:06 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 06:36:06 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY85639%27 HTTP/1.1" 200 None
2026-03-28 06:36:06 [auto1.be] INFO: Scrape type for HY85639: 2
2026-03-28 06:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 329f5553-9f8c-5271-b1f4-a37b9568bc5c with identifier: HY85639
2026-03-28 06:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329f5553-9f8c-5271-b1f4-a37b9568bc5c with scrape type 2
2026-03-28 06:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 329f5553-9f8c-5271-b1f4-a37b9568bc5c with scrape type 2
2026-03-28 06:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 329f5553-9f8c-5271-b1f4-a37b9568bc5c, identifier: HY85639
2026-03-28 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 329f5553-9f8c-5271-b1f4-a37b9568bc5c with identifier: HY85639
2026-03-28 06:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 329f5553-9f8c-5271-b1f4-a37b9568bc5c with identifier: HY85639
2026-03-28 06:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 329f5553-9f8c-5271-b1f4-a37b9568bc5c with identifier: HY85639 to the API
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:43:43Z',
 'fuel_type': 'petrol',
 'id': '329f5553-9f8c-5271-b1f4-a37b9568bc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY85639',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 26378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-24',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2024}
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY85639%27 HTTP/1.1" 200 None
2026-03-28 06:36:06 [auto1.be] INFO: Saving data for HY85639: {'auction_closing_time': 1774716223.0, 'created_time': 1774471313.179842, 'last_price_update_time': 1774679766.435206}
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY85639') HTTP/1.1" 204 0
2026-03-28 06:36:06 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP50395%27 HTTP/1.1" 200 None
2026-03-28 06:36:06 [auto1.be] INFO: Scrape type for RP50395: 2
2026-03-28 06:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: facc4be4-603d-5bc9-abf2-3fc977b1829e with identifier: RP50395
2026-03-28 06:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facc4be4-603d-5bc9-abf2-3fc977b1829e with scrape type 2
2026-03-28 06:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item facc4be4-603d-5bc9-abf2-3fc977b1829e with scrape type 2
2026-03-28 06:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: facc4be4-603d-5bc9-abf2-3fc977b1829e, identifier: RP50395
2026-03-28 06:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: facc4be4-603d-5bc9-abf2-3fc977b1829e with identifier: RP50395
2026-03-28 06:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: facc4be4-603d-5bc9-abf2-3fc977b1829e with identifier: RP50395
2026-03-28 06:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: facc4be4-603d-5bc9-abf2-3fc977b1829e with identifier: RP50395 to the API
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:50:28Z',
 'fuel_type': 'petrol',
 'id': 'facc4be4-603d-5bc9-abf2-3fc977b1829e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP50395',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 10678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-10-15',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2025}
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP50395%27 HTTP/1.1" 200 None
2026-03-28 06:36:06 [auto1.be] INFO: Saving data for RP50395: {'auction_closing_time': 1774716628.0, 'created_time': 1774471354.212912, 'last_price_update_time': 1774679766.83381}
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RP50395') HTTP/1.1" 204 0
2026-03-28 06:36:06 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-28 06:36:06 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-28 06:36:06 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-28 06:36:06 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM97787%27 HTTP/1.1" 200 None
2026-03-28 06:36:06 [auto1.be] INFO: Scrape type for XM97787: 2
2026-03-28 06:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c52e4ff-bc04-5531-bdb8-362bf6fdea62 with identifier: XM97787
2026-03-28 06:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c52e4ff-bc04-5531-bdb8-362bf6fdea62 with scrape type 2
2026-03-28 06:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c52e4ff-bc04-5531-bdb8-362bf6fdea62 with scrape type 2
2026-03-28 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c52e4ff-bc04-5531-bdb8-362bf6fdea62, identifier: XM97787
2026-03-28 06:36:07 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 17 pages/min), scraped 79 items (at 79 items/min)
2026-03-28 06:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c52e4ff-bc04-5531-bdb8-362bf6fdea62 with identifier: XM97787
2026-03-28 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c52e4ff-bc04-5531-bdb8-362bf6fdea62 with identifier: XM97787
2026-03-28 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c52e4ff-bc04-5531-bdb8-362bf6fdea62 with identifier: XM97787 to the API
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:59:39Z',
 'fuel_type': 'diesel',
 'id': '8c52e4ff-bc04-5531-bdb8-362bf6fdea62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM97787',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 148922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2015}
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM97787%27 HTTP/1.1" 200 None
2026-03-28 06:36:07 [auto1.be] INFO: Saving data for XM97787: {'auction_closing_time': 1774717179.0, 'created_time': 1773133611.960366, 'last_price_update_time': 1774679767.324889}
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM97787') HTTP/1.1" 204 0
2026-03-28 06:36:07 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-28 06:36:07 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:07 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-28 06:36:07 [auto1.be] INFO: Scrape type for CA55783: 2
2026-03-28 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-28 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96d2813-0fc5-5472-9bd6-a85f0326fd17 with scrape type 2
2026-03-28 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b96d2813-0fc5-5472-9bd6-a85f0326fd17 with scrape type 2
2026-03-28 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b96d2813-0fc5-5472-9bd6-a85f0326fd17, identifier: CA55783
2026-03-28 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-28 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-28 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783 to the API
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:36:21Z',
 'fuel_type': 'petrol',
 'id': 'b96d2813-0fc5-5472-9bd6-a85f0326fd17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA55783',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 127030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-23',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2018}
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-28 06:36:07 [auto1.be] INFO: Saving data for CA55783: {'auction_closing_time': 1774715781.0, 'created_time': 1774557428.492931, 'last_price_update_time': 1774679767.737113}
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA55783') HTTP/1.1" 204 0
2026-03-28 06:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:07 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR57009%27 HTTP/1.1" 200 None
2026-03-28 06:36:07 [auto1.be] INFO: Scrape type for TR57009: 2
2026-03-28 06:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c692b2b9-5844-5e70-9c10-d9450e3738ee with identifier: TR57009
2026-03-28 06:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c692b2b9-5844-5e70-9c10-d9450e3738ee with scrape type 2
2026-03-28 06:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c692b2b9-5844-5e70-9c10-d9450e3738ee with scrape type 2
2026-03-28 06:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c692b2b9-5844-5e70-9c10-d9450e3738ee, identifier: TR57009
2026-03-28 06:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c692b2b9-5844-5e70-9c10-d9450e3738ee with identifier: TR57009
2026-03-28 06:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c692b2b9-5844-5e70-9c10-d9450e3738ee with identifier: TR57009
2026-03-28 06:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c692b2b9-5844-5e70-9c10-d9450e3738ee with identifier: TR57009 to the API
2026-03-28 06:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:33Z',
 'fuel_type': 'petrol',
 'id': 'c692b2b9-5844-5e70-9c10-d9450e3738ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR57009',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 102925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-16',
 'seller_name': None,
 'title': 'Peugeot Partner 1.2 PureTech Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2017}
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR57009%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Saving data for TR57009: {'auction_closing_time': 1774716273.0, 'created_time': 1774471170.75108, 'last_price_update_time': 1774679768.131763}
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR57009') HTTP/1.1" 204 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV70837%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for FV70837: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB39644%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for TB39644: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN95173%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for KN95173: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for TU34385: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB21597%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for RB21597: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC36147%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for DC36147: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for DC47068: 2
2026-03-28 06:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-28 06:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2029733-bfb3-5a35-bf66-e33879308206 with scrape type 2
2026-03-28 06:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2029733-bfb3-5a35-bf66-e33879308206 with scrape type 2
2026-03-28 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2029733-bfb3-5a35-bf66-e33879308206, identifier: DC47068
2026-03-28 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-28 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068
2026-03-28 06:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2029733-bfb3-5a35-bf66-e33879308206 with identifier: DC47068 to the API
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:21:19Z',
 'fuel_type': 'petrol',
 'id': 'd2029733-bfb3-5a35-bf66-e33879308206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC47068',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 105136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Saving data for DC47068: {'auction_closing_time': 1774714879.0, 'created_time': 1774557526.424423, 'last_price_update_time': 1774679768.659295}
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC47068') HTTP/1.1" 204 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV03405%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for TV03405: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT93863%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for PT93863: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 06:36:08 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT96766%27 HTTP/1.1" 200 None
2026-03-28 06:36:08 [auto1.be] INFO: Scrape type for UT96766: 2
2026-03-28 06:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd with identifier: UT96766
2026-03-28 06:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd with scrape type 2
2026-03-28 06:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd with scrape type 2
2026-03-28 06:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd, identifier: UT96766
2026-03-28 06:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd with identifier: UT96766
2026-03-28 06:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd with identifier: UT96766
2026-03-28 06:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4785ea1f-97e9-5ee4-95ab-119b80ed4cfd with identifier: UT96766 to the API
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:27:02Z',
 'fuel_type': 'petrol',
 'id': '4785ea1f-97e9-5ee4-95ab-119b80ed4cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT96766',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 135236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT96766%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Saving data for UT96766: {'auction_closing_time': 1774715222.0, 'created_time': 1774471371.225694, 'last_price_update_time': 1774679769.248961}
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT96766') HTTP/1.1" 204 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF63760%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Scrape type for NF63760: 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Scrape type for MX90898: 2
2026-03-28 06:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-28 06:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e2cdb9-51d7-5461-9e3c-886975dd210d with scrape type 2
2026-03-28 06:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e2cdb9-51d7-5461-9e3c-886975dd210d with scrape type 2
2026-03-28 06:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17e2cdb9-51d7-5461-9e3c-886975dd210d, identifier: MX90898
2026-03-28 06:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-28 06:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898
2026-03-28 06:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17e2cdb9-51d7-5461-9e3c-886975dd210d with identifier: MX90898 to the API
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:10:10Z',
 'fuel_type': 'petrol',
 'id': '17e2cdb9-51d7-5461-9e3c-886975dd210d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX90898',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 33245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-22',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Plus',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2024}
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Saving data for MX90898: {'auction_closing_time': 1774714210.0, 'created_time': 1774557501.045591, 'last_price_update_time': 1774679769.712804}
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX90898') HTTP/1.1" 204 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32342%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Scrape type for HU32342: 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB89666%27 HTTP/1.1" 200 None
2026-03-28 06:36:09 [auto1.be] INFO: Scrape type for HB89666: 0
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-28 06:36:09 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-28 06:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:10 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:10 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 06:36:10 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-28 06:36:10 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-28 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-28 06:36:10 [auto1.be] INFO: Scrape type for DZ24480: 0
2026-03-28 06:36:10 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-28 06:36:10 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-28 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD48468%27 HTTP/1.1" 200 None
2026-03-28 06:36:10 [auto1.be] INFO: Scrape type for JD48468: 2
2026-03-28 06:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0631d75e-54e5-59c8-9b27-9df80b668780 with identifier: JD48468
2026-03-28 06:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0631d75e-54e5-59c8-9b27-9df80b668780 with scrape type 2
2026-03-28 06:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0631d75e-54e5-59c8-9b27-9df80b668780 with scrape type 2
2026-03-28 06:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0631d75e-54e5-59c8-9b27-9df80b668780, identifier: JD48468
2026-03-28 06:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0631d75e-54e5-59c8-9b27-9df80b668780 with identifier: JD48468
2026-03-28 06:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0631d75e-54e5-59c8-9b27-9df80b668780 with identifier: JD48468
2026-03-28 06:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0631d75e-54e5-59c8-9b27-9df80b668780 with identifier: JD48468 to the API
2026-03-28 06:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:53:41Z',
 'fuel_type': 'petrol',
 'id': '0631d75e-54e5-59c8-9b27-9df80b668780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD48468',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 127890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD48468%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Saving data for JD48468: {'auction_closing_time': 1774716821.0, 'created_time': 1774471408.663229, 'last_price_update_time': 1774679771.193261}
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JD48468') HTTP/1.1" 204 0
2026-03-28 06:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR78742%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Scrape type for JR78742: 2
2026-03-28 06:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4a15587-a89b-528e-9aaa-7e00f61abb43 with identifier: JR78742
2026-03-28 06:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4a15587-a89b-528e-9aaa-7e00f61abb43 with scrape type 2
2026-03-28 06:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4a15587-a89b-528e-9aaa-7e00f61abb43 with scrape type 2
2026-03-28 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4a15587-a89b-528e-9aaa-7e00f61abb43, identifier: JR78742
2026-03-28 06:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4a15587-a89b-528e-9aaa-7e00f61abb43 with identifier: JR78742
2026-03-28 06:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4a15587-a89b-528e-9aaa-7e00f61abb43 with identifier: JR78742
2026-03-28 06:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4a15587-a89b-528e-9aaa-7e00f61abb43 with identifier: JR78742 to the API
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'petrol',
 'id': 'e4a15587-a89b-528e-9aaa-7e00f61abb43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR78742',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 100516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR78742%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Saving data for JR78742: {'auction_closing_time': 1774714929.0, 'created_time': 1773301678.412816, 'last_price_update_time': 1774679771.715602}
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JR78742') HTTP/1.1" 204 0
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 06:36:11 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-28 06:36:11 [auto1.be] INFO: Scrape type for FZ81347: 2
2026-03-28 06:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-28 06:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d86124-31f4-5341-8e00-dd7766516c02 with scrape type 2
2026-03-28 06:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d86124-31f4-5341-8e00-dd7766516c02 with scrape type 2
2026-03-28 06:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5d86124-31f4-5341-8e00-dd7766516c02, identifier: FZ81347
2026-03-28 06:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-28 06:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347
2026-03-28 06:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5d86124-31f4-5341-8e00-dd7766516c02 with identifier: FZ81347 to the API
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:01:21Z',
 'fuel_type': 'petrol',
 'id': 'e5d86124-31f4-5341-8e00-dd7766516c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ81347',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 197758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2018}
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Saving data for FZ81347: {'auction_closing_time': 1774713681.0, 'created_time': 1774557442.29652, 'last_price_update_time': 1774679772.231088}
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FZ81347') HTTP/1.1" 204 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE77274%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for VE77274: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN88473%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for AN88473: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD10151%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for DD10151: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH59922%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for TH59922: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ74735%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for CZ74735: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ90167%27 HTTP/1.1" 200 None
2026-03-28 06:36:12 [auto1.be] INFO: Scrape type for YZ90167: 0
2026-03-28 06:36:12 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-28 06:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:13 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:13 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-28 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-28 06:36:13 [auto1.be] INFO: Scrape type for RV20515: 0
2026-03-28 06:36:13 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-28 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS47672%27 HTTP/1.1" 200 None
2026-03-28 06:36:13 [auto1.be] INFO: Scrape type for VS47672: 2
2026-03-28 06:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ec36f3-c80a-51ac-bf11-191d842ced16 with identifier: VS47672
2026-03-28 06:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ec36f3-c80a-51ac-bf11-191d842ced16 with scrape type 2
2026-03-28 06:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ec36f3-c80a-51ac-bf11-191d842ced16 with scrape type 2
2026-03-28 06:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96ec36f3-c80a-51ac-bf11-191d842ced16, identifier: VS47672
2026-03-28 06:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96ec36f3-c80a-51ac-bf11-191d842ced16 with identifier: VS47672
2026-03-28 06:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96ec36f3-c80a-51ac-bf11-191d842ced16 with identifier: VS47672
2026-03-28 06:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96ec36f3-c80a-51ac-bf11-191d842ced16 with identifier: VS47672 to the API
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:28:29Z',
 'fuel_type': 'diesel',
 'id': '96ec36f3-c80a-51ac-bf11-191d842ced16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS47672',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 228405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
 'transmission': 'manual',
 'trim': 'AMG Sport',
 'year': 2016}
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS47672%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Saving data for VS47672: {'auction_closing_time': 1774715309.0, 'created_time': 1774471162.892454, 'last_price_update_time': 1774679774.269031}
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VS47672') HTTP/1.1" 204 0
2026-03-28 06:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ90658%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Scrape type for BZ90658: 0
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Scrape type for JZ31869: 0
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK49914%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Scrape type for YK49914: 0
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Scrape type for LT47332: 2
2026-03-28 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-28 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2d9e26-972c-549d-b944-52de0d5b2414 with scrape type 2
2026-03-28 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd2d9e26-972c-549d-b944-52de0d5b2414 with scrape type 2
2026-03-28 06:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd2d9e26-972c-549d-b944-52de0d5b2414, identifier: LT47332
2026-03-28 06:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-28 06:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332
2026-03-28 06:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd2d9e26-972c-549d-b944-52de0d5b2414 with identifier: LT47332 to the API
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:07:44Z',
 'fuel_type': 'petrol',
 'id': 'fd2d9e26-972c-549d-b944-52de0d5b2414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT47332',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 176805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-02',
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Saving data for LT47332: {'auction_closing_time': 1774714064.0, 'created_time': 1774557430.26255, 'last_price_update_time': 1774679774.856472}
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT47332') HTTP/1.1" 204 0
2026-03-28 06:36:14 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-28 06:36:14 [auto1.be] INFO: Scrape type for TG38013: 2
2026-03-28 06:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013
2026-03-28 06:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with scrape type 2
2026-03-28 06:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with scrape type 2
2026-03-28 06:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9, identifier: TG38013
2026-03-28 06:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013
2026-03-28 06:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013
2026-03-28 06:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013 to the API
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:19:22Z',
 'fuel_type': 'diesel',
 'id': '647ee421-a5f0-5c7f-a72b-c2cf31b567a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG38013',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 101640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-28 06:36:15 [auto1.be] INFO: Saving data for TG38013: {'auction_closing_time': 1774714762.0, 'created_time': 1773134273.882044, 'last_price_update_time': 1774679775.258834}
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TG38013') HTTP/1.1" 204 0
2026-03-28 06:36:15 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-28 06:36:15 [auto1.be] INFO: Scrape type for BN53670: 2
2026-03-28 06:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670
2026-03-28 06:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f94f707-0b65-50fa-ad19-d0c345ff6450 with scrape type 2
2026-03-28 06:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f94f707-0b65-50fa-ad19-d0c345ff6450 with scrape type 2
2026-03-28 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3f94f707-0b65-50fa-ad19-d0c345ff6450, identifier: BN53670
2026-03-28 06:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670
2026-03-28 06:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670
2026-03-28 06:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3f94f707-0b65-50fa-ad19-d0c345ff6450 with identifier: BN53670 to the API
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:11:43Z',
 'fuel_type': 'petrol',
 'id': '3f94f707-0b65-50fa-ad19-d0c345ff6450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN53670',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 165616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-02',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-28 06:36:15 [auto1.be] INFO: Saving data for BN53670: {'auction_closing_time': 1774714303.0, 'created_time': 1774557506.683823, 'last_price_update_time': 1774679775.770458}
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BN53670') HTTP/1.1" 204 0
2026-03-28 06:36:15 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-28 06:36:15 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-28 06:36:15 [auto1.be] INFO: Scrape type for NN42676: 0
2026-03-28 06:36:15 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-28 06:36:15 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-28 06:36:15 [auto1.be] INFO: Scrape type for GC32489: 2
2026-03-28 06:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489
2026-03-28 06:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d979e361-81ca-5419-acb4-c9d3a10dd488 with scrape type 2
2026-03-28 06:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d979e361-81ca-5419-acb4-c9d3a10dd488 with scrape type 2
2026-03-28 06:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d979e361-81ca-5419-acb4-c9d3a10dd488, identifier: GC32489
2026-03-28 06:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489
2026-03-28 06:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489
2026-03-28 06:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489 to the API
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:12:22Z',
 'fuel_type': 'diesel',
 'id': 'd979e361-81ca-5419-acb4-c9d3a10dd488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC32489',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 251610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Saving data for GC32489: {'auction_closing_time': 1774714342.0, 'created_time': 1773134802.692111, 'last_price_update_time': 1774679776.213329}
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC32489') HTTP/1.1" 204 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for WP70532: 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for AN69845: 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH50870%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for AH50870: 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-28 06:36:16 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF91319%27 HTTP/1.1" 200 None
2026-03-28 06:36:16 [auto1.be] INFO: Scrape type for TF91319: 0
2026-03-28 06:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:17 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:17 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 06:36:17 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-28 06:36:17 [auto1.be] INFO: Scrape type for HS23763: 2
2026-03-28 06:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-28 06:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with scrape type 2
2026-03-28 06:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with scrape type 2
2026-03-28 06:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63c6c41d-00f3-5167-bdf6-b847dc50bb63, identifier: HS23763
2026-03-28 06:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-28 06:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-28 06:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763 to the API
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:53:19Z',
 'fuel_type': 'diesel',
 'id': '63c6c41d-00f3-5167-bdf6-b847dc50bb63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS23763',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 162430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2017}
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-28 06:36:17 [auto1.be] INFO: Saving data for HS23763: {'auction_closing_time': 1774716799.0, 'created_time': 1774557458.303033, 'last_price_update_time': 1774679777.72943}
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS23763') HTTP/1.1" 204 0
2026-03-28 06:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:17 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-28 06:36:17 [auto1.be] INFO: Scrape type for KU12802: 2
2026-03-28 06:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-28 06:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1c80e8-a996-510d-963b-0b20f35b4714 with scrape type 2
2026-03-28 06:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1c80e8-a996-510d-963b-0b20f35b4714 with scrape type 2
2026-03-28 06:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a1c80e8-a996-510d-963b-0b20f35b4714, identifier: KU12802
2026-03-28 06:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-28 06:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-28 06:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802 to the API
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:35Z',
 'fuel_type': 'diesel',
 'id': '0a1c80e8-a996-510d-963b-0b20f35b4714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU12802',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 221022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-16',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-28 06:36:18 [auto1.be] INFO: Saving data for KU12802: {'auction_closing_time': 1774714775.0, 'created_time': 1774557492.564324, 'last_price_update_time': 1774679778.214354}
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU12802') HTTP/1.1" 204 0
2026-03-28 06:36:18 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-28 06:36:18 [auto1.be] INFO: Scrape type for VE53331: 2
2026-03-28 06:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-28 06:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3998579b-cd59-553e-b52c-f4016f7450c0 with scrape type 2
2026-03-28 06:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3998579b-cd59-553e-b52c-f4016f7450c0 with scrape type 2
2026-03-28 06:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3998579b-cd59-553e-b52c-f4016f7450c0, identifier: VE53331
2026-03-28 06:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-28 06:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-28 06:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331 to the API
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:52:59Z',
 'fuel_type': 'petrol',
 'id': '3998579b-cd59-553e-b52c-f4016f7450c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE53331',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 146236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-16',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2018}
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-28 06:36:18 [auto1.be] INFO: Saving data for VE53331: {'auction_closing_time': 1774716779.0, 'created_time': 1774557580.403077, 'last_price_update_time': 1774679778.639179}
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE53331') HTTP/1.1" 204 0
2026-03-28 06:36:18 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS30497%27 HTTP/1.1" 200 None
2026-03-28 06:36:18 [auto1.be] INFO: Scrape type for KS30497: 0
2026-03-28 06:36:18 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-28 06:36:18 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-28 06:36:18 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-28 06:36:18 [auto1.be] INFO: Scrape type for EB09170: 2
2026-03-28 06:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-28 06:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed6c349-0194-50a2-9b7e-f83c48f59907 with scrape type 2
2026-03-28 06:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ed6c349-0194-50a2-9b7e-f83c48f59907 with scrape type 2
2026-03-28 06:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ed6c349-0194-50a2-9b7e-f83c48f59907, identifier: EB09170
2026-03-28 06:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-28 06:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-28 06:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170 to the API
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-28T16:56:16Z',
 'fuel_type': 'hybrid',
 'id': '0ed6c349-0194-50a2-9b7e-f83c48f59907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB09170',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 47398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription Expression AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression AWD',
 'year': 2021}
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Saving data for EB09170: {'auction_closing_time': 1774716976.0, 'created_time': 1774557528.012438, 'last_price_update_time': 1774679779.086319}
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB09170') HTTP/1.1" 204 0
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08447%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Scrape type for GU08447: 0
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE01545%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Scrape type for SE01545: 0
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF05397%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Scrape type for JF05397: 0
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV64637%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Scrape type for ZV64637: 0
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS12412%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Scrape type for JS12412: 2
2026-03-28 06:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf28e576-b915-54da-91da-ed492c336182 with identifier: JS12412
2026-03-28 06:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf28e576-b915-54da-91da-ed492c336182 with scrape type 2
2026-03-28 06:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf28e576-b915-54da-91da-ed492c336182 with scrape type 2
2026-03-28 06:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf28e576-b915-54da-91da-ed492c336182, identifier: JS12412
2026-03-28 06:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf28e576-b915-54da-91da-ed492c336182 with identifier: JS12412
2026-03-28 06:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf28e576-b915-54da-91da-ed492c336182 with identifier: JS12412
2026-03-28 06:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf28e576-b915-54da-91da-ed492c336182 with identifier: JS12412 to the API
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:45:30Z',
 'fuel_type': 'petrol',
 'id': 'cf28e576-b915-54da-91da-ed492c336182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS12412',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 50336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2018}
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS12412%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Saving data for JS12412: {'auction_closing_time': 1774716330.0, 'created_time': 1773520771.938259, 'last_price_update_time': 1774679779.618686}
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS12412') HTTP/1.1" 204 0
2026-03-28 06:36:19 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW35122%27 HTTP/1.1" 200 None
2026-03-28 06:36:19 [auto1.be] INFO: Scrape type for YW35122: 2
2026-03-28 06:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2fce606-80cb-5dee-8be1-f2e49832149e with identifier: YW35122
2026-03-28 06:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2fce606-80cb-5dee-8be1-f2e49832149e with scrape type 2
2026-03-28 06:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2fce606-80cb-5dee-8be1-f2e49832149e with scrape type 2
2026-03-28 06:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2fce606-80cb-5dee-8be1-f2e49832149e, identifier: YW35122
2026-03-28 06:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2fce606-80cb-5dee-8be1-f2e49832149e with identifier: YW35122
2026-03-28 06:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2fce606-80cb-5dee-8be1-f2e49832149e with identifier: YW35122
2026-03-28 06:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2fce606-80cb-5dee-8be1-f2e49832149e with identifier: YW35122 to the API
2026-03-28 06:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:09:29Z',
 'fuel_type': 'petrol',
 'id': 'b2fce606-80cb-5dee-8be1-f2e49832149e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW35122',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 86259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW35122%27 HTTP/1.1" 200 None
2026-03-28 06:36:20 [auto1.be] INFO: Saving data for YW35122: {'auction_closing_time': 1774714169.0, 'created_time': 1773136927.205745, 'last_price_update_time': 1774679780.142691}
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW35122') HTTP/1.1" 204 0
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP65458%27 HTTP/1.1" 200 None
2026-03-28 06:36:20 [auto1.be] INFO: Scrape type for VP65458: 0
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK31036%27 HTTP/1.1" 200 None
2026-03-28 06:36:20 [auto1.be] INFO: Scrape type for XK31036: 0
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-28 06:36:20 [auto1.be] INFO: Scrape type for XJ82974: 2
2026-03-28 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-28 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1742d93-7462-576b-bc9f-40c1ddd0ac02 with scrape type 2
2026-03-28 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1742d93-7462-576b-bc9f-40c1ddd0ac02 with scrape type 2
2026-03-28 06:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1742d93-7462-576b-bc9f-40c1ddd0ac02, identifier: XJ82974
2026-03-28 06:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-28 06:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-28 06:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974 to the API
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:42Z',
 'fuel_type': 'petrol',
 'id': 'd1742d93-7462-576b-bc9f-40c1ddd0ac02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ82974',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 80186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-28 06:36:20 [auto1.be] INFO: Saving data for XJ82974: {'auction_closing_time': 1774716162.0, 'created_time': 1774557500.710287, 'last_price_update_time': 1774679780.601498}
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ82974') HTTP/1.1" 204 0
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-28 06:36:20 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-28 06:36:20 [auto1.be] INFO: Scrape type for TH69152: 2
2026-03-28 06:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152
2026-03-28 06:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d445c775-1eca-591a-bf46-0db8e85dfef2 with scrape type 2
2026-03-28 06:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d445c775-1eca-591a-bf46-0db8e85dfef2 with scrape type 2
2026-03-28 06:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d445c775-1eca-591a-bf46-0db8e85dfef2, identifier: TH69152
2026-03-28 06:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152
2026-03-28 06:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152
2026-03-28 06:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152 to the API
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:15:31Z',
 'fuel_type': 'diesel',
 'id': 'd445c775-1eca-591a-bf46-0db8e85dfef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH69152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 200485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Saving data for TH69152: {'auction_closing_time': 1774714531.0, 'created_time': 1773226853.096859, 'last_price_update_time': 1774679781.309488}
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH69152') HTTP/1.1" 204 0
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM09750%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Scrape type for UM09750: 0
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Scrape type for KM78271: 0
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Scrape type for ET07668: 0
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE24792%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Scrape type for WE24792: 2
2026-03-28 06:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2ef63ce-e943-5f44-b8a6-dc4975bd795c with identifier: WE24792
2026-03-28 06:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2ef63ce-e943-5f44-b8a6-dc4975bd795c with scrape type 2
2026-03-28 06:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2ef63ce-e943-5f44-b8a6-dc4975bd795c with scrape type 2
2026-03-28 06:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2ef63ce-e943-5f44-b8a6-dc4975bd795c, identifier: WE24792
2026-03-28 06:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2ef63ce-e943-5f44-b8a6-dc4975bd795c with identifier: WE24792
2026-03-28 06:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2ef63ce-e943-5f44-b8a6-dc4975bd795c with identifier: WE24792
2026-03-28 06:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2ef63ce-e943-5f44-b8a6-dc4975bd795c with identifier: WE24792 to the API
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:00:05Z',
 'fuel_type': 'petrol',
 'id': 'd2ef63ce-e943-5f44-b8a6-dc4975bd795c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE24792',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 85800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-04',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Opel 2020',
 'transmission': 'manual',
 'trim': '2020',
 'year': 2020}
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE24792%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Saving data for WE24792: {'auction_closing_time': 1774713605.0, 'created_time': 1773238542.320336, 'last_price_update_time': 1774679781.852461}
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE24792') HTTP/1.1" 204 0
2026-03-28 06:36:21 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP41494%27 HTTP/1.1" 200 None
2026-03-28 06:36:21 [auto1.be] INFO: Scrape type for SP41494: 2
2026-03-28 06:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3d7a1aa-f23e-51fd-9aa0-802287639b66 with identifier: SP41494
2026-03-28 06:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3d7a1aa-f23e-51fd-9aa0-802287639b66 with scrape type 2
2026-03-28 06:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3d7a1aa-f23e-51fd-9aa0-802287639b66 with scrape type 2
2026-03-28 06:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3d7a1aa-f23e-51fd-9aa0-802287639b66, identifier: SP41494
2026-03-28 06:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3d7a1aa-f23e-51fd-9aa0-802287639b66 with identifier: SP41494
2026-03-28 06:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3d7a1aa-f23e-51fd-9aa0-802287639b66 with identifier: SP41494
2026-03-28 06:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3d7a1aa-f23e-51fd-9aa0-802287639b66 with identifier: SP41494 to the API
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:29Z',
 'fuel_type': 'diesel',
 'id': 'e3d7a1aa-f23e-51fd-9aa0-802287639b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP41494',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 166381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2012}
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP41494%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Saving data for SP41494: {'auction_closing_time': 1774716749.0, 'created_time': 1774471277.035674, 'last_price_update_time': 1774679782.348775}
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP41494') HTTP/1.1" 204 0
2026-03-28 06:36:22 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA31821%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Scrape type for YA31821: 0
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS83423%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Scrape type for MS83423: 0
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ35563%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Scrape type for RJ35563: 2
2026-03-28 06:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5f5faf-6de0-5a22-8b25-3133b9da72f6 with identifier: RJ35563
2026-03-28 06:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5f5faf-6de0-5a22-8b25-3133b9da72f6 with scrape type 2
2026-03-28 06:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5f5faf-6de0-5a22-8b25-3133b9da72f6 with scrape type 2
2026-03-28 06:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f5f5faf-6de0-5a22-8b25-3133b9da72f6, identifier: RJ35563
2026-03-28 06:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f5f5faf-6de0-5a22-8b25-3133b9da72f6 with identifier: RJ35563
2026-03-28 06:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f5f5faf-6de0-5a22-8b25-3133b9da72f6 with identifier: RJ35563
2026-03-28 06:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f5f5faf-6de0-5a22-8b25-3133b9da72f6 with identifier: RJ35563 to the API
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:08:41Z',
 'fuel_type': 'diesel',
 'id': '9f5f5faf-6de0-5a22-8b25-3133b9da72f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ35563',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 234797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi Multispace Business L',
 'transmission': 'manual',
 'trim': 'Multispace Business L',
 'year': 2016}
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ35563%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Saving data for RJ35563: {'auction_closing_time': 1774714121.0, 'created_time': 1774471414.959143, 'last_price_update_time': 1774679782.840401}
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ35563') HTTP/1.1" 204 0
2026-03-28 06:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Scrape type for NJ53644: 0
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 06:36:22 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-28 06:36:22 [auto1.be] INFO: Scrape type for HY35953: 2
2026-03-28 06:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-28 06:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1ea3d3-760e-53b2-a424-c38729b313d2 with scrape type 2
2026-03-28 06:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f1ea3d3-760e-53b2-a424-c38729b313d2 with scrape type 2
2026-03-28 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f1ea3d3-760e-53b2-a424-c38729b313d2, identifier: HY35953
2026-03-28 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-28 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-28 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953 to the API
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:29:15Z',
 'fuel_type': 'petrol',
 'id': '5f1ea3d3-760e-53b2-a424-c38729b313d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY35953',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 174399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-13',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 160',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Saving data for HY35953: {'auction_closing_time': 1774715355.0, 'created_time': 1774557579.471235, 'last_price_update_time': 1774679783.363431}
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY35953') HTTP/1.1" 204 0
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Scrape type for GW69223: 2
2026-03-28 06:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-28 06:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a5edd5-90b6-58cc-ad3f-f133d9393958 with scrape type 2
2026-03-28 06:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a5edd5-90b6-58cc-ad3f-f133d9393958 with scrape type 2
2026-03-28 06:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79a5edd5-90b6-58cc-ad3f-f133d9393958, identifier: GW69223
2026-03-28 06:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-28 06:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-28 06:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223 to the API
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:46Z',
 'fuel_type': 'petrol',
 'id': '79a5edd5-90b6-58cc-ad3f-f133d9393958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW69223',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 70481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Saving data for GW69223: {'auction_closing_time': 1774714666.0, 'created_time': 1774557564.216653, 'last_price_update_time': 1774679783.807883}
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW69223') HTTP/1.1" 204 0
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW54495%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Scrape type for KW54495: 0
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW19960%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Scrape type for EW19960: 0
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL30706%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Scrape type for VL30706: 0
2026-03-28 06:36:23 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44813%27 HTTP/1.1" 200 None
2026-03-28 06:36:23 [auto1.be] INFO: Scrape type for DT44813: 2
2026-03-28 06:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cece2e44-5ab7-5b6c-a41d-c41435d726b8 with identifier: DT44813
2026-03-28 06:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cece2e44-5ab7-5b6c-a41d-c41435d726b8 with scrape type 2
2026-03-28 06:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cece2e44-5ab7-5b6c-a41d-c41435d726b8 with scrape type 2
2026-03-28 06:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cece2e44-5ab7-5b6c-a41d-c41435d726b8, identifier: DT44813
2026-03-28 06:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cece2e44-5ab7-5b6c-a41d-c41435d726b8 with identifier: DT44813
2026-03-28 06:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cece2e44-5ab7-5b6c-a41d-c41435d726b8 with identifier: DT44813
2026-03-28 06:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cece2e44-5ab7-5b6c-a41d-c41435d726b8 with identifier: DT44813 to the API
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:35Z',
 'fuel_type': 'diesel',
 'id': 'cece2e44-5ab7-5b6c-a41d-c41435d726b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT44813',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 258100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-02',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44813%27 HTTP/1.1" 200 None
2026-03-28 06:36:24 [auto1.be] INFO: Saving data for DT44813: {'auction_closing_time': 1774716335.0, 'created_time': 1774471136.095362, 'last_price_update_time': 1774679784.340355}
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT44813') HTTP/1.1" 204 0
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS77634%27 HTTP/1.1" 200 None
2026-03-28 06:36:24 [auto1.be] INFO: Scrape type for GS77634: 0
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH29158%27 HTTP/1.1" 200 None
2026-03-28 06:36:24 [auto1.be] INFO: Scrape type for NH29158: 0
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY53822%27 HTTP/1.1" 200 None
2026-03-28 06:36:24 [auto1.be] INFO: Scrape type for DY53822: 0
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-28 06:36:24 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-28 06:36:24 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-28 06:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:25 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-28 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA35148%27 HTTP/1.1" 200 None
2026-03-28 06:36:25 [auto1.be] INFO: Scrape type for RA35148: 0
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-28 06:36:25 [auto1.be] INFO: Scrape type for GF59002: 0
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-28 06:36:25 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-28 06:36:25 [auto1.be] INFO: Scrape type for XM10489: 2
2026-03-28 06:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-28 06:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f440364-48c8-56e5-b5b4-01812722451f with scrape type 2
2026-03-28 06:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f440364-48c8-56e5-b5b4-01812722451f with scrape type 2
2026-03-28 06:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f440364-48c8-56e5-b5b4-01812722451f, identifier: XM10489
2026-03-28 06:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-28 06:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489
2026-03-28 06:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f440364-48c8-56e5-b5b4-01812722451f with identifier: XM10489 to the API
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:06:50Z',
 'fuel_type': 'diesel',
 'id': '0f440364-48c8-56e5-b5b4-01812722451f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM10489',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 160771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-04',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi 15th',
 'transmission': 'manual',
 'trim': '15th',
 'year': 2011}
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-28 06:36:26 [auto1.be] INFO: Saving data for XM10489: {'auction_closing_time': 1774714010.0, 'created_time': 1774557536.624046, 'last_price_update_time': 1774679786.208976}
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM10489') HTTP/1.1" 204 0
2026-03-28 06:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:26 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-28 06:36:26 [auto1.be] INFO: Scrape type for TK63545: 2
2026-03-28 06:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-28 06:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681647e4-ce55-599e-a8ac-87af81fae583 with scrape type 2
2026-03-28 06:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681647e4-ce55-599e-a8ac-87af81fae583 with scrape type 2
2026-03-28 06:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 681647e4-ce55-599e-a8ac-87af81fae583, identifier: TK63545
2026-03-28 06:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-28 06:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-28 06:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545 to the API
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:34:52Z',
 'fuel_type': 'diesel',
 'id': '681647e4-ce55-599e-a8ac-87af81fae583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK63545',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Modus',
 'odometer': 49012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Renault Grand Modus 1.5 dCi Lafuma',
 'transmission': 'automatic',
 'trim': 'Lafuma',
 'year': 2010}
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-28 06:36:26 [auto1.be] INFO: Saving data for TK63545: {'auction_closing_time': 1774715692.0, 'created_time': 1774557507.935121, 'last_price_update_time': 1774679786.725725}
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK63545') HTTP/1.1" 204 0
2026-03-28 06:36:26 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 06:36:26 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 06:36:26 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB43323%27 HTTP/1.1" 200 None
2026-03-28 06:36:26 [auto1.be] INFO: Scrape type for EB43323: 2
2026-03-28 06:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2bcdda4-3e58-5b32-82c2-d75c51baf581 with identifier: EB43323
2026-03-28 06:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2bcdda4-3e58-5b32-82c2-d75c51baf581 with scrape type 2
2026-03-28 06:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2bcdda4-3e58-5b32-82c2-d75c51baf581 with scrape type 2
2026-03-28 06:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2bcdda4-3e58-5b32-82c2-d75c51baf581, identifier: EB43323
2026-03-28 06:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2bcdda4-3e58-5b32-82c2-d75c51baf581 with identifier: EB43323
2026-03-28 06:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2bcdda4-3e58-5b32-82c2-d75c51baf581 with identifier: EB43323
2026-03-28 06:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2bcdda4-3e58-5b32-82c2-d75c51baf581 with identifier: EB43323 to the API
2026-03-28 06:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-28T16:57:19Z',
 'fuel_type': 'hybrid',
 'id': 'f2bcdda4-3e58-5b32-82c2-d75c51baf581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB43323',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 189428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI e-tron quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB43323%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Saving data for EB43323: {'auction_closing_time': 1774717039.0, 'created_time': 1773223812.786328, 'last_price_update_time': 1774679787.173053}
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB43323') HTTP/1.1" 204 0
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Scrape type for PV35906: 0
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Scrape type for SR71847: 0
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: US70780
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH06099%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Scrape type for JH06099: 2
2026-03-28 06:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77ef776-b79c-58b3-9b54-86b92aeff685 with identifier: JH06099
2026-03-28 06:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77ef776-b79c-58b3-9b54-86b92aeff685 with scrape type 2
2026-03-28 06:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77ef776-b79c-58b3-9b54-86b92aeff685 with scrape type 2
2026-03-28 06:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77ef776-b79c-58b3-9b54-86b92aeff685, identifier: JH06099
2026-03-28 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77ef776-b79c-58b3-9b54-86b92aeff685 with identifier: JH06099
2026-03-28 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77ef776-b79c-58b3-9b54-86b92aeff685 with identifier: JH06099
2026-03-28 06:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77ef776-b79c-58b3-9b54-86b92aeff685 with identifier: JH06099 to the API
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:12:50Z',
 'fuel_type': 'diesel',
 'id': 'b77ef776-b79c-58b3-9b54-86b92aeff685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH06099',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 154412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH06099%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Saving data for JH06099: {'auction_closing_time': 1774714370.0, 'created_time': 1773348616.782705, 'last_price_update_time': 1774679787.638251}
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH06099') HTTP/1.1" 204 0
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ27954%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Scrape type for WJ27954: 0
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-28 06:36:27 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-28 06:36:27 [auto1.be] INFO: Scrape type for MZ96160: 2
2026-03-28 06:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-28 06:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with scrape type 2
2026-03-28 06:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with scrape type 2
2026-03-28 06:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f, identifier: MZ96160
2026-03-28 06:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-28 06:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160
2026-03-28 06:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f with identifier: MZ96160 to the API
2026-03-28 06:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:03:57Z',
 'fuel_type': 'hybrid',
 'id': 'df518eb2-6d64-5c3d-a0b5-74b6ae8fae9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ96160',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 23940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-03',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-28 06:36:28 [auto1.be] INFO: Saving data for MZ96160: {'auction_closing_time': 1774713837.0, 'created_time': 1774557552.121896, 'last_price_update_time': 1774679788.151159}
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ96160') HTTP/1.1" 204 0
2026-03-28 06:36:28 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR58381%27 HTTP/1.1" 200 None
2026-03-28 06:36:28 [auto1.be] INFO: Scrape type for TR58381: 0
2026-03-28 06:36:28 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM08929%27 HTTP/1.1" 200 None
2026-03-28 06:36:28 [auto1.be] INFO: Scrape type for WM08929: 2
2026-03-28 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9351bb26-2d55-5a52-bc55-1af40cd595ea with identifier: WM08929
2026-03-28 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9351bb26-2d55-5a52-bc55-1af40cd595ea with scrape type 2
2026-03-28 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9351bb26-2d55-5a52-bc55-1af40cd595ea with scrape type 2
2026-03-28 06:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9351bb26-2d55-5a52-bc55-1af40cd595ea, identifier: WM08929
2026-03-28 06:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9351bb26-2d55-5a52-bc55-1af40cd595ea with identifier: WM08929
2026-03-28 06:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9351bb26-2d55-5a52-bc55-1af40cd595ea with identifier: WM08929
2026-03-28 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9351bb26-2d55-5a52-bc55-1af40cd595ea with identifier: WM08929 to the API
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:05Z',
 'fuel_type': 'diesel',
 'id': '9351bb26-2d55-5a52-bc55-1af40cd595ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM08929',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 183205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-12',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM08929%27 HTTP/1.1" 200 None
2026-03-28 06:36:28 [auto1.be] INFO: Saving data for WM08929: {'auction_closing_time': 1774716965.0, 'created_time': 1774471319.376464, 'last_price_update_time': 1774679788.564458}
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM08929') HTTP/1.1" 204 0
2026-03-28 06:36:28 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-28 06:36:28 [auto1.be] INFO: Scrape type for YN20871: 2
2026-03-28 06:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871
2026-03-28 06:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with scrape type 2
2026-03-28 06:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with scrape type 2
2026-03-28 06:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca, identifier: YN20871
2026-03-28 06:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871
2026-03-28 06:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871
2026-03-28 06:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871 to the API
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:08:48Z',
 'fuel_type': 'diesel',
 'id': '4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN20871',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 98429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-28 06:36:28 [auto1.be] INFO: Saving data for YN20871: {'auction_closing_time': 1774714128.0, 'created_time': 1773238354.96279, 'last_price_update_time': 1774679788.977681}
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN20871') HTTP/1.1" 204 0
2026-03-28 06:36:28 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-28 06:36:28 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Scrape type for HS04385: 0
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Scrape type for FV41606: 0
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN50786%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Scrape type for YN50786: 2
2026-03-28 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45274a6f-b8ff-5205-8333-d8b7a98d5665 with identifier: YN50786
2026-03-28 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45274a6f-b8ff-5205-8333-d8b7a98d5665 with scrape type 2
2026-03-28 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45274a6f-b8ff-5205-8333-d8b7a98d5665 with scrape type 2
2026-03-28 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45274a6f-b8ff-5205-8333-d8b7a98d5665, identifier: YN50786
2026-03-28 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45274a6f-b8ff-5205-8333-d8b7a98d5665 with identifier: YN50786
2026-03-28 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45274a6f-b8ff-5205-8333-d8b7a98d5665 with identifier: YN50786
2026-03-28 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45274a6f-b8ff-5205-8333-d8b7a98d5665 with identifier: YN50786 to the API
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:33Z',
 'fuel_type': 'petrol',
 'id': '45274a6f-b8ff-5205-8333-d8b7a98d5665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN50786',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 174451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2016}
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN50786%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Saving data for YN50786: {'auction_closing_time': 1774713873.0, 'created_time': 1773136035.134562, 'last_price_update_time': 1774679789.429642}
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN50786') HTTP/1.1" 204 0
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM09652%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Scrape type for CM09652: 2
2026-03-28 06:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70f28e9c-87fb-53ae-ad90-5a18570bdb4a with identifier: CM09652
2026-03-28 06:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70f28e9c-87fb-53ae-ad90-5a18570bdb4a with scrape type 2
2026-03-28 06:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70f28e9c-87fb-53ae-ad90-5a18570bdb4a with scrape type 2
2026-03-28 06:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70f28e9c-87fb-53ae-ad90-5a18570bdb4a, identifier: CM09652
2026-03-28 06:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70f28e9c-87fb-53ae-ad90-5a18570bdb4a with identifier: CM09652
2026-03-28 06:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70f28e9c-87fb-53ae-ad90-5a18570bdb4a with identifier: CM09652
2026-03-28 06:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70f28e9c-87fb-53ae-ad90-5a18570bdb4a with identifier: CM09652 to the API
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:05Z',
 'fuel_type': 'diesel',
 'id': '70f28e9c-87fb-53ae-ad90-5a18570bdb4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM09652',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 154058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D3 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2018}
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM09652%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Saving data for CM09652: {'auction_closing_time': 1774714865.0, 'created_time': 1773137602.556625, 'last_price_update_time': 1774679789.950915}
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM09652') HTTP/1.1" 204 0
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-28 06:36:29 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-28 06:36:29 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 06:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-28 06:36:30 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-28 06:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:30 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL97420%27 HTTP/1.1" 200 None
2026-03-28 06:36:30 [auto1.be] INFO: Scrape type for TL97420: 0
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05336%27 HTTP/1.1" 200 None
2026-03-28 06:36:30 [auto1.be] INFO: Scrape type for GS05336: 2
2026-03-28 06:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ffd937-7e9f-5e38-8031-962a118000b5 with identifier: GS05336
2026-03-28 06:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ffd937-7e9f-5e38-8031-962a118000b5 with scrape type 2
2026-03-28 06:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ffd937-7e9f-5e38-8031-962a118000b5 with scrape type 2
2026-03-28 06:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6ffd937-7e9f-5e38-8031-962a118000b5, identifier: GS05336
2026-03-28 06:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6ffd937-7e9f-5e38-8031-962a118000b5 with identifier: GS05336
2026-03-28 06:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6ffd937-7e9f-5e38-8031-962a118000b5 with identifier: GS05336
2026-03-28 06:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6ffd937-7e9f-5e38-8031-962a118000b5 with identifier: GS05336 to the API
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:03:40Z',
 'fuel_type': 'diesel',
 'id': 'b6ffd937-7e9f-5e38-8031-962a118000b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS05336',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 289334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-07',
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 D V6 Premium Luxury',
 'transmission': 'automatic',
 'trim': 'Premium Luxury',
 'year': 2013}
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05336%27 HTTP/1.1" 200 None
2026-03-28 06:36:30 [auto1.be] INFO: Saving data for GS05336: {'auction_closing_time': 1774713820.0, 'created_time': 1774471134.421669, 'last_price_update_time': 1774679790.682327}
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS05336') HTTP/1.1" 204 0
2026-03-28 06:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-28 06:36:30 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU70188%27 HTTP/1.1" 200 None
2026-03-28 06:36:30 [auto1.be] INFO: Scrape type for JU70188: 2
2026-03-28 06:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914cab7c-bec9-51a3-b549-4ac23bb02649 with identifier: JU70188
2026-03-28 06:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914cab7c-bec9-51a3-b549-4ac23bb02649 with scrape type 2
2026-03-28 06:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 914cab7c-bec9-51a3-b549-4ac23bb02649 with scrape type 2
2026-03-28 06:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 914cab7c-bec9-51a3-b549-4ac23bb02649, identifier: JU70188
2026-03-28 06:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 914cab7c-bec9-51a3-b549-4ac23bb02649 with identifier: JU70188
2026-03-28 06:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 914cab7c-bec9-51a3-b549-4ac23bb02649 with identifier: JU70188
2026-03-28 06:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 914cab7c-bec9-51a3-b549-4ac23bb02649 with identifier: JU70188 to the API
2026-03-28 06:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:36:21Z',
 'fuel_type': 'petrol',
 'id': '914cab7c-bec9-51a3-b549-4ac23bb02649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU70188',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 116336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2016}
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU70188%27 HTTP/1.1" 200 None
2026-03-28 06:36:31 [auto1.be] INFO: Saving data for JU70188: {'auction_closing_time': 1774715781.0, 'created_time': 1774471390.237683, 'last_price_update_time': 1774679791.328378}
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU70188') HTTP/1.1" 204 0
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-28 06:36:31 [auto1.be] INFO: Scrape type for EV01420: 2
2026-03-28 06:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-28 06:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with scrape type 2
2026-03-28 06:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with scrape type 2
2026-03-28 06:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5c5eadd-3797-54fb-a3b8-7ec3624c6765, identifier: EV01420
2026-03-28 06:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-28 06:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-28 06:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420 to the API
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:28Z',
 'fuel_type': 'hybrid',
 'id': 'b5c5eadd-3797-54fb-a3b8-7ec3624c6765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV01420',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 121300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2018}
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-28 06:36:31 [auto1.be] INFO: Saving data for EV01420: {'auction_closing_time': 1774714948.0, 'created_time': 1774557545.352942, 'last_price_update_time': 1774679791.876415}
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV01420') HTTP/1.1" 204 0
2026-03-28 06:36:31 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK84429%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for RK84429: 0
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK31159%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for DK31159: 0
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for RZ47312: 2
2026-03-28 06:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-28 06:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522ac188-a2f0-54c8-8094-c7986a060761 with scrape type 2
2026-03-28 06:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 522ac188-a2f0-54c8-8094-c7986a060761 with scrape type 2
2026-03-28 06:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 522ac188-a2f0-54c8-8094-c7986a060761, identifier: RZ47312
2026-03-28 06:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-28 06:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-28 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312 to the API
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:48:07Z',
 'fuel_type': 'petrol',
 'id': '522ac188-a2f0-54c8-8094-c7986a060761',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ47312',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 153502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-23',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Iconic',
 'transmission': 'manual',
 'trim': 'Iconic',
 'year': 2016}
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Saving data for RZ47312: {'auction_closing_time': 1774716487.0, 'created_time': 1774557528.859222, 'last_price_update_time': 1774679792.492355}
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ47312') HTTP/1.1" 204 0
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for MU76581: 0
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-28 06:36:32 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Scrape type for VP91071: 2
2026-03-28 06:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-28 06:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with scrape type 2
2026-03-28 06:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with scrape type 2
2026-03-28 06:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a, identifier: VP91071
2026-03-28 06:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-28 06:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-28 06:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071 to the API
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:13:07Z',
 'fuel_type': 'petrol',
 'id': '9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP91071',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 129499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-26',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Generation',
 'transmission': 'manual',
 'trim': 'Generation',
 'year': 2008}
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-28 06:36:32 [auto1.be] INFO: Saving data for VP91071: {'auction_closing_time': 1774714387.0, 'created_time': 1774557465.388795, 'last_price_update_time': 1774679792.944719}
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP91071') HTTP/1.1" 204 0
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-28 06:36:33 [auto1.be] INFO: Scrape type for EJ45818: 0
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX63908%27 HTTP/1.1" 200 None
2026-03-28 06:36:33 [auto1.be] INFO: Scrape type for WX63908: 0
2026-03-28 06:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:33 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-28 06:36:33 [auto1.be] INFO: Scrape type for RL53364: 0
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 06:36:33 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-28 06:36:33 [auto1.be] INFO: Scrape type for WH07577: 2
2026-03-28 06:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-28 06:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with scrape type 2
2026-03-28 06:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with scrape type 2
2026-03-28 06:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64, identifier: WH07577
2026-03-28 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-28 06:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-28 06:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577 to the API
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:17Z',
 'fuel_type': 'petrol',
 'id': '7da79ca0-21e1-5e34-bca8-668ba4bbcf64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH07577',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 91621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-01',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
 'transmission': 'automatic',
 'trim': 'ACT',
 'year': 2022}
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-28 06:36:34 [auto1.be] INFO: Saving data for WH07577: {'auction_closing_time': 1774716377.0, 'created_time': 1774557541.521377, 'last_price_update_time': 1774679794.314212}
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH07577') HTTP/1.1" 204 0
2026-03-28 06:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:34 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM52966%27 HTTP/1.1" 200 None
2026-03-28 06:36:34 [auto1.be] INFO: Scrape type for SM52966: 0
2026-03-28 06:36:34 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-28 06:36:34 [auto1.be] INFO: Scrape type for NC57966: 2
2026-03-28 06:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-28 06:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a06727b-0917-5c59-8ec7-31b454997a54 with scrape type 2
2026-03-28 06:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a06727b-0917-5c59-8ec7-31b454997a54 with scrape type 2
2026-03-28 06:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a06727b-0917-5c59-8ec7-31b454997a54, identifier: NC57966
2026-03-28 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 06:36:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966
2026-03-28 06:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a06727b-0917-5c59-8ec7-31b454997a54 with identifier: NC57966 to the API
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:04:36Z',
 'fuel_type': 'petrol',
 'id': '4a06727b-0917-5c59-8ec7-31b454997a54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC57966',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-28 06:36:34 [auto1.be] INFO: Saving data for NC57966: {'auction_closing_time': 1774713876.0, 'created_time': 1774557446.262756, 'last_price_update_time': 1774679794.892172}
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC57966') HTTP/1.1" 204 0
2026-03-28 06:36:34 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 06:36:34 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-28 06:36:34 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-28 06:36:34 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Scrape type for FR59063: 0
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ82774%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Scrape type for BZ82774: 2
2026-03-28 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d72c676-4886-5a10-afea-e4dafaaa9289 with identifier: BZ82774
2026-03-28 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d72c676-4886-5a10-afea-e4dafaaa9289 with scrape type 2
2026-03-28 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d72c676-4886-5a10-afea-e4dafaaa9289 with scrape type 2
2026-03-28 06:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d72c676-4886-5a10-afea-e4dafaaa9289, identifier: BZ82774
2026-03-28 06:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d72c676-4886-5a10-afea-e4dafaaa9289 with identifier: BZ82774
2026-03-28 06:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d72c676-4886-5a10-afea-e4dafaaa9289 with identifier: BZ82774
2026-03-28 06:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d72c676-4886-5a10-afea-e4dafaaa9289 with identifier: BZ82774 to the API
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'diesel',
 'id': '3d72c676-4886-5a10-afea-e4dafaaa9289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ82774',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 580862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-11',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ82774%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Saving data for BZ82774: {'auction_closing_time': 1774713711.0, 'created_time': 1773132457.98752, 'last_price_update_time': 1774679795.420306}
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ82774') HTTP/1.1" 204 0
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS18318%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Scrape type for KS18318: 0
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Scrape type for EE45657: 2
2026-03-28 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-28 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with scrape type 2
2026-03-28 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with scrape type 2
2026-03-28 06:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c, identifier: EE45657
2026-03-28 06:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-28 06:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-28 06:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657 to the API
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:12Z',
 'fuel_type': 'diesel',
 'id': '1adca9e0-0bbf-5cb5-9425-dd1ea75e826c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE45657',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 138780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 ed4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2015}
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Saving data for EE45657: {'auction_closing_time': 1774715532.0, 'created_time': 1774557522.339571, 'last_price_update_time': 1774679795.89474}
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EE45657') HTTP/1.1" 204 0
2026-03-28 06:36:35 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW21160%27 HTTP/1.1" 200 None
2026-03-28 06:36:35 [auto1.be] INFO: Scrape type for MW21160: 2
2026-03-28 06:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5516cf37-dc76-522d-851f-81428812c676 with identifier: MW21160
2026-03-28 06:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5516cf37-dc76-522d-851f-81428812c676 with scrape type 2
2026-03-28 06:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5516cf37-dc76-522d-851f-81428812c676 with scrape type 2
2026-03-28 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5516cf37-dc76-522d-851f-81428812c676, identifier: MW21160
2026-03-28 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5516cf37-dc76-522d-851f-81428812c676 with identifier: MW21160
2026-03-28 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5516cf37-dc76-522d-851f-81428812c676 with identifier: MW21160
2026-03-28 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5516cf37-dc76-522d-851f-81428812c676 with identifier: MW21160 to the API
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:30:17Z',
 'fuel_type': 'petrol',
 'id': '5516cf37-dc76-522d-851f-81428812c676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW21160',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 156191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-06',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW21160%27 HTTP/1.1" 200 None
2026-03-28 06:36:36 [auto1.be] INFO: Saving data for MW21160: {'auction_closing_time': 1774715417.0, 'created_time': 1773347797.684917, 'last_price_update_time': 1774679796.292827}
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW21160') HTTP/1.1" 204 0
2026-03-28 06:36:36 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-28 06:36:36 [auto1.be] INFO: Scrape type for WG20951: 2
2026-03-28 06:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-28 06:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with scrape type 2
2026-03-28 06:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with scrape type 2
2026-03-28 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d, identifier: WG20951
2026-03-28 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-28 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-28 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951 to the API
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:23Z',
 'fuel_type': 'diesel',
 'id': '18e3f3b6-e72f-5ee3-99d7-0aef4708b08d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG20951',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 94341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-28 06:36:36 [auto1.be] INFO: Saving data for WG20951: {'auction_closing_time': 1774715243.0, 'created_time': 1774557537.788328, 'last_price_update_time': 1774679796.773967}
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG20951') HTTP/1.1" 204 0
2026-03-28 06:36:36 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK67306%27 HTTP/1.1" 200 None
2026-03-28 06:36:36 [auto1.be] INFO: Scrape type for FK67306: 2
2026-03-28 06:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d300753-52f3-53d2-9811-b89f872f37fc with identifier: FK67306
2026-03-28 06:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d300753-52f3-53d2-9811-b89f872f37fc with scrape type 2
2026-03-28 06:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d300753-52f3-53d2-9811-b89f872f37fc with scrape type 2
2026-03-28 06:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d300753-52f3-53d2-9811-b89f872f37fc, identifier: FK67306
2026-03-28 06:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d300753-52f3-53d2-9811-b89f872f37fc with identifier: FK67306
2026-03-28 06:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d300753-52f3-53d2-9811-b89f872f37fc with identifier: FK67306
2026-03-28 06:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d300753-52f3-53d2-9811-b89f872f37fc with identifier: FK67306 to the API
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:48:39Z',
 'fuel_type': 'hybrid',
 'id': '8d300753-52f3-53d2-9811-b89f872f37fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK67306',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 155653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-17',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK67306%27 HTTP/1.1" 200 None
2026-03-28 06:36:37 [auto1.be] INFO: Saving data for FK67306: {'auction_closing_time': 1774716519.0, 'created_time': 1773239272.307633, 'last_price_update_time': 1774679797.222221}
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK67306') HTTP/1.1" 204 0
2026-03-28 06:36:37 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-28 06:36:37 [auto1.be] INFO: Scrape type for DE33834: 2
2026-03-28 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-28 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0346a38f-a7f7-5f29-800a-bb81ada4be6b with scrape type 2
2026-03-28 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0346a38f-a7f7-5f29-800a-bb81ada4be6b with scrape type 2
2026-03-28 06:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0346a38f-a7f7-5f29-800a-bb81ada4be6b, identifier: DE33834
2026-03-28 06:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-28 06:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-28 06:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834 to the API
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:12:22Z',
 'fuel_type': 'petrol',
 'id': '0346a38f-a7f7-5f29-800a-bb81ada4be6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE33834',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 93865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Platino',
 'transmission': 'manual',
 'trim': 'Platino',
 'year': 2011}
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-28 06:36:37 [auto1.be] INFO: Saving data for DE33834: {'auction_closing_time': 1774714342.0, 'created_time': 1774557563.91213, 'last_price_update_time': 1774679797.661155}
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE33834') HTTP/1.1" 204 0
2026-03-28 06:36:37 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-28 06:36:37 [auto1.be] INFO: Scrape type for UA67521: 2
2026-03-28 06:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-28 06:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d784d92e-8b86-579c-9fd5-fe2688df45fa with scrape type 2
2026-03-28 06:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d784d92e-8b86-579c-9fd5-fe2688df45fa with scrape type 2
2026-03-28 06:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d784d92e-8b86-579c-9fd5-fe2688df45fa, identifier: UA67521
2026-03-28 06:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-28 06:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-28 06:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521 to the API
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:29:48Z',
 'fuel_type': 'petrol',
 'id': 'd784d92e-8b86-579c-9fd5-fe2688df45fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA67521',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 14527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Saving data for UA67521: {'auction_closing_time': 1774715388.0, 'created_time': 1774557565.107562, 'last_price_update_time': 1774679798.076117}
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA67521') HTTP/1.1" 204 0
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE17510%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Scrape type for KE17510: 2
2026-03-28 06:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71eeb56a-63fe-518e-a063-9b601a7b848b with identifier: KE17510
2026-03-28 06:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71eeb56a-63fe-518e-a063-9b601a7b848b with scrape type 2
2026-03-28 06:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71eeb56a-63fe-518e-a063-9b601a7b848b with scrape type 2
2026-03-28 06:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71eeb56a-63fe-518e-a063-9b601a7b848b, identifier: KE17510
2026-03-28 06:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71eeb56a-63fe-518e-a063-9b601a7b848b with identifier: KE17510
2026-03-28 06:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71eeb56a-63fe-518e-a063-9b601a7b848b with identifier: KE17510
2026-03-28 06:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71eeb56a-63fe-518e-a063-9b601a7b848b with identifier: KE17510 to the API
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:26:31Z',
 'fuel_type': 'petrol',
 'id': '71eeb56a-63fe-518e-a063-9b601a7b848b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE17510',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 165861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-04',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2012}
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE17510%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Saving data for KE17510: {'auction_closing_time': 1774715191.0, 'created_time': 1773132728.636981, 'last_price_update_time': 1774679798.511203}
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE17510') HTTP/1.1" 204 0
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-28 06:36:38 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-28 06:36:38 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-28 06:36:38 [auto1.be] INFO: Scrape type for HJ27727: 2
2026-03-28 06:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727
2026-03-28 06:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd06346-9e38-511a-9814-a315edae3dcc with scrape type 2
2026-03-28 06:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecd06346-9e38-511a-9814-a315edae3dcc with scrape type 2
2026-03-28 06:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ecd06346-9e38-511a-9814-a315edae3dcc, identifier: HJ27727
2026-03-28 06:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727
2026-03-28 06:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727
2026-03-28 06:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727 to the API
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:59:00Z',
 'fuel_type': 'petrol',
 'id': 'ecd06346-9e38-511a-9814-a315edae3dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ27727',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 128930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': None,
 'title': 'Volvo V40 1.5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2019}
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Saving data for HJ27727: {'auction_closing_time': 1774717140.0, 'created_time': 1773136924.245805, 'last_price_update_time': 1774679799.041314}
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ27727') HTTP/1.1" 204 0
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP97194%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Scrape type for AP97194: 0
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP87063%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Scrape type for TP87063: 0
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Scrape type for TX99790: 2
2026-03-28 06:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790
2026-03-28 06:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827fde2d-7546-599e-8772-8f271fb01470 with scrape type 2
2026-03-28 06:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827fde2d-7546-599e-8772-8f271fb01470 with scrape type 2
2026-03-28 06:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 827fde2d-7546-599e-8772-8f271fb01470, identifier: TX99790
2026-03-28 06:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790
2026-03-28 06:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790
2026-03-28 06:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790 to the API
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:37Z',
 'fuel_type': 'diesel',
 'id': '827fde2d-7546-599e-8772-8f271fb01470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX99790',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 261282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC',
 'year': 2018}
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Saving data for TX99790: {'auction_closing_time': 1774714477.0, 'created_time': 1773301683.630884, 'last_price_update_time': 1774679799.566129}
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX99790') HTTP/1.1" 204 0
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL40552%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Scrape type for JL40552: 0
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-28 06:36:39 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB89489%27 HTTP/1.1" 200 None
2026-03-28 06:36:39 [auto1.be] INFO: Scrape type for AB89489: 2
2026-03-28 06:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2 with identifier: AB89489
2026-03-28 06:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2 with scrape type 2
2026-03-28 06:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2 with scrape type 2
2026-03-28 06:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2, identifier: AB89489
2026-03-28 06:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2 with identifier: AB89489
2026-03-28 06:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2 with identifier: AB89489
2026-03-28 06:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2 with identifier: AB89489 to the API
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:33Z',
 'fuel_type': 'diesel',
 'id': '7bda66f0-3c6e-5596-8ea2-a419b0a5d9f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB89489',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 225215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB89489%27 HTTP/1.1" 200 None
2026-03-28 06:36:40 [auto1.be] INFO: Saving data for AB89489: {'auction_closing_time': 1774714113.0, 'created_time': 1773132035.528649, 'last_price_update_time': 1774679800.01755}
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB89489') HTTP/1.1" 204 0
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF35218%27 HTTP/1.1" 200 None
2026-03-28 06:36:40 [auto1.be] INFO: Scrape type for AF35218: 2
2026-03-28 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9 with identifier: AF35218
2026-03-28 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9 with scrape type 2
2026-03-28 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9 with scrape type 2
2026-03-28 06:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9, identifier: AF35218
2026-03-28 06:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9 with identifier: AF35218
2026-03-28 06:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9 with identifier: AF35218
2026-03-28 06:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9 with identifier: AF35218 to the API
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:44:32Z',
 'fuel_type': 'hybrid',
 'id': 'cc81f4d1-11f0-5b5b-9ce5-59c490eb71a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF35218',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 149852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-17',
 'seller_name': None,
 'title': 'Audi Q3 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF35218%27 HTTP/1.1" 200 None
2026-03-28 06:36:40 [auto1.be] INFO: Saving data for AF35218: {'auction_closing_time': 1774716272.0, 'created_time': 1773239565.420051, 'last_price_update_time': 1774679800.549739}
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF35218') HTTP/1.1" 204 0
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25655%27 HTTP/1.1" 200 None
2026-03-28 06:36:40 [auto1.be] INFO: Scrape type for WG25655: 2
2026-03-28 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466a99d7-3b9b-52c9-8fce-3a75aaa36243 with identifier: WG25655
2026-03-28 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466a99d7-3b9b-52c9-8fce-3a75aaa36243 with scrape type 2
2026-03-28 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466a99d7-3b9b-52c9-8fce-3a75aaa36243 with scrape type 2
2026-03-28 06:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 466a99d7-3b9b-52c9-8fce-3a75aaa36243, identifier: WG25655
2026-03-28 06:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 466a99d7-3b9b-52c9-8fce-3a75aaa36243 with identifier: WG25655
2026-03-28 06:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 466a99d7-3b9b-52c9-8fce-3a75aaa36243 with identifier: WG25655
2026-03-28 06:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 466a99d7-3b9b-52c9-8fce-3a75aaa36243 with identifier: WG25655 to the API
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:16:22Z',
 'fuel_type': 'diesel',
 'id': '466a99d7-3b9b-52c9-8fce-3a75aaa36243',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG25655',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 95394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-03',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25655%27 HTTP/1.1" 200 None
2026-03-28 06:36:40 [auto1.be] INFO: Saving data for WG25655: {'auction_closing_time': 1774714582.0, 'created_time': 1774471361.210633, 'last_price_update_time': 1774679800.946678}
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG25655') HTTP/1.1" 204 0
2026-03-28 06:36:40 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-28 06:36:40 [auto1.be] INFO: Scrape type for CX21788: 2
2026-03-28 06:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-28 06:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 465c9300-8ddd-5bc8-8016-823cfd813a08 with scrape type 2
2026-03-28 06:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 465c9300-8ddd-5bc8-8016-823cfd813a08 with scrape type 2
2026-03-28 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 465c9300-8ddd-5bc8-8016-823cfd813a08, identifier: CX21788
2026-03-28 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-28 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-28 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788 to the API
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:58:26Z',
 'fuel_type': 'diesel',
 'id': '465c9300-8ddd-5bc8-8016-823cfd813a08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX21788',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 291166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Elegance',
 'year': 2011}
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-28 06:36:41 [auto1.be] INFO: Saving data for CX21788: {'auction_closing_time': 1774717106.0, 'created_time': 1774557583.177437, 'last_price_update_time': 1774679801.346413}
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX21788') HTTP/1.1" 204 0
2026-03-28 06:36:41 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-28 06:36:41 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT74022%27 HTTP/1.1" 200 None
2026-03-28 06:36:41 [auto1.be] INFO: Scrape type for XT74022: 2
2026-03-28 06:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 143325b9-329c-51a3-860d-9691b5091065 with identifier: XT74022
2026-03-28 06:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 143325b9-329c-51a3-860d-9691b5091065 with scrape type 2
2026-03-28 06:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 143325b9-329c-51a3-860d-9691b5091065 with scrape type 2
2026-03-28 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 143325b9-329c-51a3-860d-9691b5091065, identifier: XT74022
2026-03-28 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 143325b9-329c-51a3-860d-9691b5091065 with identifier: XT74022
2026-03-28 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 143325b9-329c-51a3-860d-9691b5091065 with identifier: XT74022
2026-03-28 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 143325b9-329c-51a3-860d-9691b5091065 with identifier: XT74022 to the API
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:01:45Z',
 'fuel_type': 'diesel',
 'id': '143325b9-329c-51a3-860d-9691b5091065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT74022',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 226606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-09',
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT74022%27 HTTP/1.1" 200 None
2026-03-28 06:36:41 [auto1.be] INFO: Saving data for XT74022: {'auction_closing_time': 1774713705.0, 'created_time': 1774471368.492955, 'last_price_update_time': 1774679801.75459}
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT74022') HTTP/1.1" 204 0
2026-03-28 06:36:41 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-28 06:36:41 [auto1.be] INFO: Scrape type for XE18058: 2
2026-03-28 06:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058
2026-03-28 06:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with scrape type 2
2026-03-28 06:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with scrape type 2
2026-03-28 06:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f, identifier: XE18058
2026-03-28 06:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058
2026-03-28 06:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058
2026-03-28 06:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058 to the API
2026-03-28 06:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:41:34Z',
 'fuel_type': 'diesel',
 'id': '6aded8fe-0ab2-580b-8a7a-b78fe47f830f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE18058',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 402075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-29',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Saving data for XE18058: {'auction_closing_time': 1774716094.0, 'created_time': 1773136158.490518, 'last_price_update_time': 1774679802.163781}
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE18058') HTTP/1.1" 204 0
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR44079%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Scrape type for BR44079: 2
2026-03-28 06:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e46a4364-dd90-5e34-80c8-c57615fa3557 with identifier: BR44079
2026-03-28 06:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46a4364-dd90-5e34-80c8-c57615fa3557 with scrape type 2
2026-03-28 06:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e46a4364-dd90-5e34-80c8-c57615fa3557 with scrape type 2
2026-03-28 06:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e46a4364-dd90-5e34-80c8-c57615fa3557, identifier: BR44079
2026-03-28 06:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e46a4364-dd90-5e34-80c8-c57615fa3557 with identifier: BR44079
2026-03-28 06:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e46a4364-dd90-5e34-80c8-c57615fa3557 with identifier: BR44079
2026-03-28 06:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e46a4364-dd90-5e34-80c8-c57615fa3557 with identifier: BR44079 to the API
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:03:14Z',
 'fuel_type': 'diesel',
 'id': 'e46a4364-dd90-5e34-80c8-c57615fa3557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR44079',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 112978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2016}
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR44079%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Saving data for BR44079: {'auction_closing_time': 1774713794.0, 'created_time': 1774557577.924342, 'last_price_update_time': 1774679802.615657}
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR44079') HTTP/1.1" 204 0
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN27020%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Scrape type for KN27020: 0
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-28 06:36:42 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC35394%27 HTTP/1.1" 200 None
2026-03-28 06:36:42 [auto1.be] INFO: Scrape type for AC35394: 2
2026-03-28 06:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83 with identifier: AC35394
2026-03-28 06:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83 with scrape type 2
2026-03-28 06:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83 with scrape type 2
2026-03-28 06:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83, identifier: AC35394
2026-03-28 06:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83 with identifier: AC35394
2026-03-28 06:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83 with identifier: AC35394
2026-03-28 06:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83 with identifier: AC35394 to the API
2026-03-28 06:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:15Z',
 'fuel_type': 'diesel',
 'id': 'bd7ebaaf-a58a-5b6c-8046-ac89b9e94e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC35394',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 140055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'BMW 3er 318d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC35394%27 HTTP/1.1" 200 None
2026-03-28 06:36:43 [auto1.be] INFO: Saving data for AC35394: {'auction_closing_time': 1774714035.0, 'created_time': 1774471279.6973, 'last_price_update_time': 1774679803.194723}
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC35394') HTTP/1.1" 204 0
2026-03-28 06:36:43 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 06:36:43 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-28 06:36:43 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-28 06:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:43 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:43 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-28 06:36:43 [auto1.be] INFO: Scrape type for JX10335: 0
2026-03-28 06:36:43 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-28 06:36:43 [auto1.be] INFO: Scrape type for TL70885: 2
2026-03-28 06:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-28 06:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ca0251-7234-5965-976e-1562d61880cc with scrape type 2
2026-03-28 06:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73ca0251-7234-5965-976e-1562d61880cc with scrape type 2
2026-03-28 06:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73ca0251-7234-5965-976e-1562d61880cc, identifier: TL70885
2026-03-28 06:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-28 06:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-28 06:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885 to the API
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:54:06Z',
 'fuel_type': 'petrol',
 'id': '73ca0251-7234-5965-976e-1562d61880cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL70885',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 118945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-14',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2009}
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-28 06:36:43 [auto1.be] INFO: Saving data for TL70885: {'auction_closing_time': 1774716846.0, 'created_time': 1774557549.57697, 'last_price_update_time': 1774679803.727809}
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL70885') HTTP/1.1" 204 0
2026-03-28 06:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:43 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-28 06:36:43 [auto1.be] INFO: Scrape type for TW22956: 2
2026-03-28 06:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-28 06:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with scrape type 2
2026-03-28 06:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with scrape type 2
2026-03-28 06:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51, identifier: TW22956
2026-03-28 06:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-28 06:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-28 06:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956 to the API
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-28T16:19:05Z',
 'fuel_type': 'hybrid',
 'id': '6284fe65-c9e2-5fba-8b4b-9a82be49dc51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW22956',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 228232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-03',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Saving data for TW22956: {'auction_closing_time': 1774714745.0, 'created_time': 1774557567.67692, 'last_price_update_time': 1774679804.241032}
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW22956') HTTP/1.1" 204 0
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM70865%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Scrape type for HM70865: 2
2026-03-28 06:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ddf4a05-8330-5e6c-93b8-6e5813aa4827 with identifier: HM70865
2026-03-28 06:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ddf4a05-8330-5e6c-93b8-6e5813aa4827 with scrape type 2
2026-03-28 06:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ddf4a05-8330-5e6c-93b8-6e5813aa4827 with scrape type 2
2026-03-28 06:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9ddf4a05-8330-5e6c-93b8-6e5813aa4827, identifier: HM70865
2026-03-28 06:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9ddf4a05-8330-5e6c-93b8-6e5813aa4827 with identifier: HM70865
2026-03-28 06:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9ddf4a05-8330-5e6c-93b8-6e5813aa4827 with identifier: HM70865
2026-03-28 06:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9ddf4a05-8330-5e6c-93b8-6e5813aa4827 with identifier: HM70865 to the API
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:11:57Z',
 'fuel_type': 'gas',
 'id': '9ddf4a05-8330-5e6c-93b8-6e5813aa4827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM70865',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 86830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-02',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM70865%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Saving data for HM70865: {'auction_closing_time': 1774714317.0, 'created_time': 1774471305.267242, 'last_price_update_time': 1774679804.656519}
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM70865') HTTP/1.1" 204 0
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR60731%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Scrape type for RR60731: 0
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Scrape type for VW71513: 0
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-28 06:36:44 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-28 06:36:44 [auto1.be] INFO: Scrape type for UF35860: 2
2026-03-28 06:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-28 06:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae05e32-fe1d-51b7-ad9a-9a527d456b92 with scrape type 2
2026-03-28 06:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae05e32-fe1d-51b7-ad9a-9a527d456b92 with scrape type 2
2026-03-28 06:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cae05e32-fe1d-51b7-ad9a-9a527d456b92, identifier: UF35860
2026-03-28 06:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-28 06:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-28 06:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860 to the API
2026-03-28 06:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:05:28Z',
 'fuel_type': 'diesel',
 'id': 'cae05e32-fe1d-51b7-ad9a-9a527d456b92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF35860',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 88536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2016}
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-28 06:36:45 [auto1.be] INFO: Saving data for UF35860: {'auction_closing_time': 1774713928.0, 'created_time': 1774557539.934275, 'last_price_update_time': 1774679805.146387}
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF35860') HTTP/1.1" 204 0
2026-03-28 06:36:45 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR16317%27 HTTP/1.1" 200 None
2026-03-28 06:36:45 [auto1.be] INFO: Scrape type for MR16317: 2
2026-03-28 06:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89825195-052a-5195-8aef-588cbfd9c998 with identifier: MR16317
2026-03-28 06:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89825195-052a-5195-8aef-588cbfd9c998 with scrape type 2
2026-03-28 06:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89825195-052a-5195-8aef-588cbfd9c998 with scrape type 2
2026-03-28 06:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89825195-052a-5195-8aef-588cbfd9c998, identifier: MR16317
2026-03-28 06:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89825195-052a-5195-8aef-588cbfd9c998 with identifier: MR16317
2026-03-28 06:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89825195-052a-5195-8aef-588cbfd9c998 with identifier: MR16317
2026-03-28 06:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89825195-052a-5195-8aef-588cbfd9c998 with identifier: MR16317 to the API
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:17:04Z',
 'fuel_type': 'petrol',
 'id': '89825195-052a-5195-8aef-588cbfd9c998',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR16317',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'XLV',
 'odometer': 120245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Ssangyong XLV 1.6 Sapphire 4x2',
 'transmission': 'manual',
 'trim': 'Sapphire 4x2',
 'year': 2019}
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR16317%27 HTTP/1.1" 200 None
2026-03-28 06:36:45 [auto1.be] INFO: Saving data for MR16317: {'auction_closing_time': 1774714624.0, 'created_time': 1774471386.054352, 'last_price_update_time': 1774679805.634711}
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR16317') HTTP/1.1" 204 0
2026-03-28 06:36:45 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP38880%27 HTTP/1.1" 200 None
2026-03-28 06:36:45 [auto1.be] INFO: Scrape type for CP38880: 2
2026-03-28 06:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d44ffd3-3b96-5781-8f7c-4b8594326dad with identifier: CP38880
2026-03-28 06:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d44ffd3-3b96-5781-8f7c-4b8594326dad with scrape type 2
2026-03-28 06:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d44ffd3-3b96-5781-8f7c-4b8594326dad with scrape type 2
2026-03-28 06:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d44ffd3-3b96-5781-8f7c-4b8594326dad, identifier: CP38880
2026-03-28 06:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d44ffd3-3b96-5781-8f7c-4b8594326dad with identifier: CP38880
2026-03-28 06:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d44ffd3-3b96-5781-8f7c-4b8594326dad with identifier: CP38880
2026-03-28 06:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d44ffd3-3b96-5781-8f7c-4b8594326dad with identifier: CP38880 to the API
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:12Z',
 'fuel_type': 'petrol',
 'id': '0d44ffd3-3b96-5781-8f7c-4b8594326dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP38880',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 57656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2018}
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP38880%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Saving data for CP38880: {'auction_closing_time': 1774715232.0, 'created_time': 1774471173.154187, 'last_price_update_time': 1774679806.060594}
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP38880') HTTP/1.1" 204 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW93174%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for VW93174: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for SJ72272: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB89914%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for ZB89914: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for ZC75548: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for XC31503: 2
2026-03-28 06:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-28 06:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with scrape type 2
2026-03-28 06:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with scrape type 2
2026-03-28 06:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20fb55a4-bc54-58df-bbe8-bd3234b9e464, identifier: XC31503
2026-03-28 06:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-28 06:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-28 06:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503 to the API
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:46:48Z',
 'fuel_type': 'petrol',
 'id': '20fb55a4-bc54-58df-bbe8-bd3234b9e464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC31503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 130320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Saving data for XC31503: {'auction_closing_time': 1774716408.0, 'created_time': 1774557558.5286, 'last_price_update_time': 1774679806.569596}
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC31503') HTTP/1.1" 204 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB02189%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for CB02189: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ85398%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for FJ85398: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC39555%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for PC39555: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for GN71373: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN84271%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for XN84271: 0
2026-03-28 06:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:46 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-28 06:36:46 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-28 06:36:46 [auto1.be] INFO: Scrape type for NN99297: 2
2026-03-28 06:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-28 06:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd6770b-a75a-5710-a004-ebad33427a3e with scrape type 2
2026-03-28 06:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd6770b-a75a-5710-a004-ebad33427a3e with scrape type 2
2026-03-28 06:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9bd6770b-a75a-5710-a004-ebad33427a3e, identifier: NN99297
2026-03-28 06:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-28 06:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-28 06:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297 to the API
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:59:33Z',
 'fuel_type': 'petrol',
 'id': '9bd6770b-a75a-5710-a004-ebad33427a3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN99297',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 41663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-08',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Go',
 'transmission': 'manual',
 'trim': 'Go',
 'year': 2015}
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Saving data for NN99297: {'auction_closing_time': 1774717173.0, 'created_time': 1774557520.503704, 'last_price_update_time': 1774679807.276943}
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN99297') HTTP/1.1" 204 0
2026-03-28 06:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for HW03040: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH93162%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for YH93162: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB63888%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for FB63888: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE27589%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for HE27589: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-28 06:36:47 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA95611%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Scrape type for MA95611: 2
2026-03-28 06:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6 with identifier: MA95611
2026-03-28 06:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6 with scrape type 2
2026-03-28 06:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6 with scrape type 2
2026-03-28 06:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6, identifier: MA95611
2026-03-28 06:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6 with identifier: MA95611
2026-03-28 06:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6 with identifier: MA95611
2026-03-28 06:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6 with identifier: MA95611 to the API
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:27:24Z',
 'fuel_type': 'diesel',
 'id': '3ddb5f0f-3e11-5f45-8e0e-c0ea8aafa8f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA95611',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 214098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA95611%27 HTTP/1.1" 200 None
2026-03-28 06:36:47 [auto1.be] INFO: Saving data for MA95611: {'auction_closing_time': 1774715244.0, 'created_time': 1774471109.21879, 'last_price_update_time': 1774679807.993544}
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA95611') HTTP/1.1" 204 0
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC02969%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Scrape type for TC02969: 0
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN67239%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Scrape type for YN67239: 0
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW46644%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Scrape type for RW46644: 2
2026-03-28 06:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e41e9baf-0a5f-505d-a201-92b606571b93 with identifier: RW46644
2026-03-28 06:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41e9baf-0a5f-505d-a201-92b606571b93 with scrape type 2
2026-03-28 06:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e41e9baf-0a5f-505d-a201-92b606571b93 with scrape type 2
2026-03-28 06:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e41e9baf-0a5f-505d-a201-92b606571b93, identifier: RW46644
2026-03-28 06:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e41e9baf-0a5f-505d-a201-92b606571b93 with identifier: RW46644
2026-03-28 06:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e41e9baf-0a5f-505d-a201-92b606571b93 with identifier: RW46644
2026-03-28 06:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e41e9baf-0a5f-505d-a201-92b606571b93 with identifier: RW46644 to the API
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:40:46Z',
 'fuel_type': 'diesel',
 'id': 'e41e9baf-0a5f-505d-a201-92b606571b93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW46644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 212447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-11',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW46644%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Saving data for RW46644: {'auction_closing_time': 1774716046.0, 'created_time': 1773135357.233292, 'last_price_update_time': 1774679808.553951}
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW46644') HTTP/1.1" 204 0
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-28 06:36:48 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-28 06:36:48 [auto1.be] INFO: Scrape type for RE48196: 2
2026-03-28 06:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-28 06:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd237f58-eccc-50ed-b36d-78cba6c28d6a with scrape type 2
2026-03-28 06:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd237f58-eccc-50ed-b36d-78cba6c28d6a with scrape type 2
2026-03-28 06:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd237f58-eccc-50ed-b36d-78cba6c28d6a, identifier: RE48196
2026-03-28 06:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-28 06:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-28 06:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196 to the API
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:14:55Z',
 'fuel_type': 'diesel',
 'id': 'dd237f58-eccc-50ed-b36d-78cba6c28d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE48196',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 206620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-21',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 06:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-28 06:36:49 [auto1.be] INFO: Saving data for RE48196: {'auction_closing_time': 1774714495.0, 'created_time': 1774557447.875121, 'last_price_update_time': 1774679809.005034}
2026-03-28 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE48196') HTTP/1.1" 204 0
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-28 06:36:49 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-28 06:36:49 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-28 06:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:36:59 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1663 | hits on page: 40
2026-03-28 06:36:59 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-28 06:36:59 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-28 06:36:59 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-28 06:36:59 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-28 06:36:59 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 06:36:59 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-28 06:36:59 [auto1.be] INFO: Scrape type for XL43279: 2
2026-03-28 06:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-28 06:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e61ddf2-108f-51dd-b934-ef49eda36b47 with scrape type 2
2026-03-28 06:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e61ddf2-108f-51dd-b934-ef49eda36b47 with scrape type 2
2026-03-28 06:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9e61ddf2-108f-51dd-b934-ef49eda36b47, identifier: XL43279
2026-03-28 06:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-28 06:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-28 06:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279 to the API
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:03Z',
 'fuel_type': 'diesel',
 'id': '9e61ddf2-108f-51dd-b934-ef49eda36b47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL43279',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 204240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2016}
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-28 06:37:00 [auto1.be] INFO: Saving data for XL43279: {'auction_closing_time': 1774714083.0, 'created_time': 1774557431.051864, 'last_price_update_time': 1774679820.423154}
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL43279') HTTP/1.1" 204 0
2026-03-28 06:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:00 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-28 06:37:00 [auto1.be] INFO: Scrape type for LM94739: 2
2026-03-28 06:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-28 06:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with scrape type 2
2026-03-28 06:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with scrape type 2
2026-03-28 06:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b, identifier: LM94739
2026-03-28 06:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-28 06:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-28 06:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739 to the API
2026-03-28 06:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:26Z',
 'fuel_type': 'diesel',
 'id': '4aeb3cc8-f65d-5432-b1f8-532bac2ed33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM94739',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 93719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2016}
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Saving data for LM94739: {'auction_closing_time': 1774714706.0, 'created_time': 1774557493.226975, 'last_price_update_time': 1774679821.182209}
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM94739') HTTP/1.1" 204 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS55716%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for HS55716: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for MJ01257: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB82847%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for UB82847: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR21590%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for HR21590: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE31569%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for NE31569: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF25932%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for TF25932: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD17756%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for BD17756: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for WT96819: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE05105%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for GE05105: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM85548%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for XM85548: 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH22912%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for LH22912: 2
2026-03-28 06:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 453ec0e2-90af-53e3-a86d-da2a188ce654 with identifier: LH22912
2026-03-28 06:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453ec0e2-90af-53e3-a86d-da2a188ce654 with scrape type 2
2026-03-28 06:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 453ec0e2-90af-53e3-a86d-da2a188ce654 with scrape type 2
2026-03-28 06:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 453ec0e2-90af-53e3-a86d-da2a188ce654, identifier: LH22912
2026-03-28 06:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 453ec0e2-90af-53e3-a86d-da2a188ce654 with identifier: LH22912
2026-03-28 06:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 453ec0e2-90af-53e3-a86d-da2a188ce654 with identifier: LH22912
2026-03-28 06:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 453ec0e2-90af-53e3-a86d-da2a188ce654 with identifier: LH22912 to the API
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:39:00Z',
 'fuel_type': 'diesel',
 'id': '453ec0e2-90af-53e3-a86d-da2a188ce654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH22912',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 182050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-18',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2009}
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH22912%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Saving data for LH22912: {'auction_closing_time': 1774715940.0, 'created_time': 1774471312.240214, 'last_price_update_time': 1774679821.825503}
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH22912') HTTP/1.1" 204 0
2026-03-28 06:37:01 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP73132%27 HTTP/1.1" 200 None
2026-03-28 06:37:01 [auto1.be] INFO: Scrape type for EP73132: 2
2026-03-28 06:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d with identifier: EP73132
2026-03-28 06:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d with scrape type 2
2026-03-28 06:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d with scrape type 2
2026-03-28 06:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d, identifier: EP73132
2026-03-28 06:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d with identifier: EP73132
2026-03-28 06:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d with identifier: EP73132
2026-03-28 06:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15ba7a1b-52c3-50ff-94d7-e880d8d5c61d with identifier: EP73132 to the API
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:56Z',
 'fuel_type': 'petrol',
 'id': '15ba7a1b-52c3-50ff-94d7-e880d8d5c61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP73132',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 61341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'BMW 2er 220i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP73132%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Saving data for EP73132: {'auction_closing_time': 1774715636.0, 'created_time': 1774471314.157642, 'last_price_update_time': 1774679822.341341}
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP73132') HTTP/1.1" 204 0
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Scrape type for YN92139: 2
2026-03-28 06:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139
2026-03-28 06:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with scrape type 2
2026-03-28 06:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with scrape type 2
2026-03-28 06:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb, identifier: YN92139
2026-03-28 06:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139
2026-03-28 06:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139
2026-03-28 06:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139 to the API
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:06:49Z',
 'fuel_type': 'diesel',
 'id': 'f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN92139',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 185112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-17',
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 TDI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Saving data for YN92139: {'auction_closing_time': 1774714009.0, 'created_time': 1773301643.434219, 'last_price_update_time': 1774679822.789265}
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN92139') HTTP/1.1" 204 0
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK21410%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Scrape type for YK21410: 0
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN48415%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Scrape type for HN48415: 0
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX75796%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Scrape type for ZX75796: 0
2026-03-28 06:37:02 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN00182%27 HTTP/1.1" 200 None
2026-03-28 06:37:02 [auto1.be] INFO: Scrape type for WN00182: 0
2026-03-28 06:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:03 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for RS16623: 0
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF21497%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for HF21497: 0
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK03982%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for CK03982: 0
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15441%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for CH15441: 0
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for HM28534: 0
2026-03-28 06:37:03 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN58260%27 HTTP/1.1" 200 None
2026-03-28 06:37:03 [auto1.be] INFO: Scrape type for YN58260: 2
2026-03-28 06:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2 with identifier: YN58260
2026-03-28 06:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2 with scrape type 2
2026-03-28 06:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2 with scrape type 2
2026-03-28 06:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2, identifier: YN58260
2026-03-28 06:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2 with identifier: YN58260
2026-03-28 06:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2 with identifier: YN58260
2026-03-28 06:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30ca5bad-f63b-5f6f-ae01-98b9cdef63e2 with identifier: YN58260 to the API
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:15:12Z',
 'fuel_type': 'diesel',
 'id': '30ca5bad-f63b-5f6f-ae01-98b9cdef63e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN58260',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 50118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-18',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Active Pro',
 'transmission': 'manual',
 'trim': 'Active Pro',
 'year': 2010}
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN58260%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Saving data for YN58260: {'auction_closing_time': 1774714512.0, 'created_time': 1773137060.06852, 'last_price_update_time': 1774679824.334739}
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN58260') HTTP/1.1" 204 0
2026-03-28 06:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC53588%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Scrape type for ZC53588: 0
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG60858%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Scrape type for WG60858: 2
2026-03-28 06:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e4efa8-f2c6-51cc-b483-a6a97f5fd119 with identifier: WG60858
2026-03-28 06:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e4efa8-f2c6-51cc-b483-a6a97f5fd119 with scrape type 2
2026-03-28 06:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e4efa8-f2c6-51cc-b483-a6a97f5fd119 with scrape type 2
2026-03-28 06:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17e4efa8-f2c6-51cc-b483-a6a97f5fd119, identifier: WG60858
2026-03-28 06:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17e4efa8-f2c6-51cc-b483-a6a97f5fd119 with identifier: WG60858
2026-03-28 06:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17e4efa8-f2c6-51cc-b483-a6a97f5fd119 with identifier: WG60858
2026-03-28 06:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17e4efa8-f2c6-51cc-b483-a6a97f5fd119 with identifier: WG60858 to the API
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:23:57Z',
 'fuel_type': 'petrol',
 'id': '17e4efa8-f2c6-51cc-b483-a6a97f5fd119',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG60858',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 82057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Audi Q8 55 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG60858%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Saving data for WG60858: {'auction_closing_time': 1774715037.0, 'created_time': 1773135893.374922, 'last_price_update_time': 1774679824.89182}
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG60858') HTTP/1.1" 204 0
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA07784%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Scrape type for PA07784: 0
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-28 06:37:04 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL24574%27 HTTP/1.1" 200 None
2026-03-28 06:37:04 [auto1.be] INFO: Scrape type for JL24574: 2
2026-03-28 06:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2 with identifier: JL24574
2026-03-28 06:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2 with scrape type 2
2026-03-28 06:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2 with scrape type 2
2026-03-28 06:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2, identifier: JL24574
2026-03-28 06:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2 with identifier: JL24574
2026-03-28 06:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2 with identifier: JL24574
2026-03-28 06:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2 with identifier: JL24574 to the API
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:32:17Z',
 'fuel_type': 'diesel',
 'id': '8d74ee38-0b35-5ad1-bb9c-c7bbeecae4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL24574',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 188302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-16',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Grand',
 'transmission': 'manual',
 'trim': 'Grand',
 'year': 2017}
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL24574%27 HTTP/1.1" 200 None
2026-03-28 06:37:05 [auto1.be] INFO: Saving data for JL24574: {'auction_closing_time': 1774715537.0, 'created_time': 1774471322.734017, 'last_price_update_time': 1774679825.335289}
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JL24574') HTTP/1.1" 204 0
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-28 06:37:05 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB18331%27 HTTP/1.1" 200 None
2026-03-28 06:37:05 [auto1.be] INFO: Scrape type for GB18331: 0
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-28 06:37:05 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-28 06:37:05 [auto1.be] INFO: Scrape type for CC56747: 2
2026-03-28 06:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-28 06:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a1b969-fbb5-57df-a009-0ca297dac6f2 with scrape type 2
2026-03-28 06:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a1b969-fbb5-57df-a009-0ca297dac6f2 with scrape type 2
2026-03-28 06:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79a1b969-fbb5-57df-a009-0ca297dac6f2, identifier: CC56747
2026-03-28 06:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-28 06:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-28 06:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747 to the API
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:58Z',
 'fuel_type': 'diesel',
 'id': '79a1b969-fbb5-57df-a009-0ca297dac6f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC56747',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 152936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-04',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-28 06:37:06 [auto1.be] INFO: Saving data for CC56747: {'auction_closing_time': 1774716418.0, 'created_time': 1774557540.286488, 'last_price_update_time': 1774679826.098588}
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC56747') HTTP/1.1" 204 0
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-28 06:37:06 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE98600%27 HTTP/1.1" 200 None
2026-03-28 06:37:06 [auto1.be] INFO: Scrape type for GE98600: 0
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-28 06:37:06 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM50519%27 HTTP/1.1" 200 None
2026-03-28 06:37:06 [auto1.be] INFO: Scrape type for UM50519: 0
2026-03-28 06:37:06 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 12 pages/min), scraped 161 items (at 82 items/min)
2026-03-28 06:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 06:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:07 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for TS78695: 2
2026-03-28 06:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695
2026-03-28 06:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a46ff3-2841-596e-82ad-2237ea14a7d5 with scrape type 2
2026-03-28 06:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a46ff3-2841-596e-82ad-2237ea14a7d5 with scrape type 2
2026-03-28 06:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a46ff3-2841-596e-82ad-2237ea14a7d5, identifier: TS78695
2026-03-28 06:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695
2026-03-28 06:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695
2026-03-28 06:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695 to the API
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:05:56Z',
 'fuel_type': 'diesel',
 'id': '96a46ff3-2841-596e-82ad-2237ea14a7d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS78695',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 134886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Saving data for TS78695: {'auction_closing_time': 1774713956.0, 'created_time': 1773866304.909616, 'last_price_update_time': 1774679827.779012}
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS78695') HTTP/1.1" 204 0
2026-03-28 06:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL98118%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for UL98118: 0
2026-03-28 06:37:07 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-28 06:37:07 [auto1.be] INFO: Scrape type for AY48728: 2
2026-03-28 06:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728
2026-03-28 06:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d22e983-63db-5272-9092-a0543eb9f6ac with scrape type 2
2026-03-28 06:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d22e983-63db-5272-9092-a0543eb9f6ac with scrape type 2
2026-03-28 06:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d22e983-63db-5272-9092-a0543eb9f6ac, identifier: AY48728
2026-03-28 06:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728
2026-03-28 06:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728
2026-03-28 06:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728 to the API
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:31:05Z',
 'fuel_type': 'petrol',
 'id': '5d22e983-63db-5272-9092-a0543eb9f6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY48728',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 72841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-29',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Saving data for AY48728: {'auction_closing_time': 1774715465.0, 'created_time': 1773238228.814637, 'last_price_update_time': 1774679828.312981}
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY48728') HTTP/1.1" 204 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for KW49487: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for JC58807: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA01247%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for PA01247: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV96305%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for NV96305: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN32726%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for PN32726: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-28 06:37:08 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK27252%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Scrape type for VK27252: 2
2026-03-28 06:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349d1969-14b9-5bbb-8da8-3d8e797639d7 with identifier: VK27252
2026-03-28 06:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349d1969-14b9-5bbb-8da8-3d8e797639d7 with scrape type 2
2026-03-28 06:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349d1969-14b9-5bbb-8da8-3d8e797639d7 with scrape type 2
2026-03-28 06:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 349d1969-14b9-5bbb-8da8-3d8e797639d7, identifier: VK27252
2026-03-28 06:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 349d1969-14b9-5bbb-8da8-3d8e797639d7 with identifier: VK27252
2026-03-28 06:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 349d1969-14b9-5bbb-8da8-3d8e797639d7 with identifier: VK27252
2026-03-28 06:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 349d1969-14b9-5bbb-8da8-3d8e797639d7 with identifier: VK27252 to the API
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:19:27Z',
 'fuel_type': 'hybrid',
 'id': '349d1969-14b9-5bbb-8da8-3d8e797639d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK27252',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 193748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid Dynamic Business',
 'transmission': 'automatic',
 'trim': 'Dynamic Business',
 'year': 2022}
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK27252%27 HTTP/1.1" 200 None
2026-03-28 06:37:08 [auto1.be] INFO: Saving data for VK27252: {'auction_closing_time': 1774714767.0, 'created_time': 1774471035.447634, 'last_price_update_time': 1774679828.909369}
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK27252') HTTP/1.1" 204 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL06267%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for ZL06267: 2
2026-03-28 06:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6328249b-c303-59a9-8449-3c97bc2eb402 with identifier: ZL06267
2026-03-28 06:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6328249b-c303-59a9-8449-3c97bc2eb402 with scrape type 2
2026-03-28 06:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6328249b-c303-59a9-8449-3c97bc2eb402 with scrape type 2
2026-03-28 06:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6328249b-c303-59a9-8449-3c97bc2eb402, identifier: ZL06267
2026-03-28 06:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6328249b-c303-59a9-8449-3c97bc2eb402 with identifier: ZL06267
2026-03-28 06:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6328249b-c303-59a9-8449-3c97bc2eb402 with identifier: ZL06267
2026-03-28 06:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6328249b-c303-59a9-8449-3c97bc2eb402 with identifier: ZL06267 to the API
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:31:00Z',
 'fuel_type': 'petrol',
 'id': '6328249b-c303-59a9-8449-3c97bc2eb402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL06267',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 134805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-13',
 'seller_name': None,
 'title': 'BMW 1er 125i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL06267%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Saving data for ZL06267: {'auction_closing_time': 1774715460.0, 'created_time': 1774471414.619445, 'last_price_update_time': 1774679829.409102}
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL06267') HTTP/1.1" 204 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP77494%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for HP77494: 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-28 06:37:09 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-28 06:37:09 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-28 06:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:10 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-28 06:37:10 [auto1.be] INFO: Scrape type for JW86952: 2
2026-03-28 06:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-28 06:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3530de6-400f-5adc-933c-f0269a7613a1 with scrape type 2
2026-03-28 06:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3530de6-400f-5adc-933c-f0269a7613a1 with scrape type 2
2026-03-28 06:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3530de6-400f-5adc-933c-f0269a7613a1, identifier: JW86952
2026-03-28 06:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-28 06:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-28 06:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952 to the API
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:33Z',
 'fuel_type': 'petrol',
 'id': 'd3530de6-400f-5adc-933c-f0269a7613a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW86952',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 115260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-28 06:37:10 [auto1.be] INFO: Saving data for JW86952: {'auction_closing_time': 1774717053.0, 'created_time': 1774557463.944303, 'last_price_update_time': 1774679830.815126}
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW86952') HTTP/1.1" 204 0
2026-03-28 06:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM10661%27 HTTP/1.1" 200 None
2026-03-28 06:37:10 [auto1.be] INFO: Scrape type for LM10661: 0
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ73148%27 HTTP/1.1" 200 None
2026-03-28 06:37:10 [auto1.be] INFO: Scrape type for WJ73148: 0
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-28 06:37:10 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB59400%27 HTTP/1.1" 200 None
2026-03-28 06:37:10 [auto1.be] INFO: Scrape type for UB59400: 0
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-28 06:37:10 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for FV38279: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY06710%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for EY06710: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX67951%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for RX67951: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM98751%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for ZM98751: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU29895%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for YU29895: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC47788%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for PC47788: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ17204%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for XJ17204: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX95723%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for JX95723: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP70611%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for JP70611: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20411%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for BY20411: 0
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-28 06:37:11 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED46000%27 HTTP/1.1" 200 None
2026-03-28 06:37:11 [auto1.be] INFO: Scrape type for ED46000: 0
2026-03-28 06:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:12 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU65745%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for MU65745: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV66357%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for UV66357: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU96332%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for XU96332: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS41207%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for GS41207: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU53193%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for SU53193: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG72902%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for EG72902: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC45178%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for YC45178: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU26363%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for ZU26363: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ61910%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for ZJ61910: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH02429%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for PH02429: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK22486%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for RK22486: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP17871%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for SP17871: 0
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 06:37:12 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-28 06:37:12 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-28 06:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:13 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for LJ62513: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK56681%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for PK56681: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW39031%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for BW39031: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF15536%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for BF15536: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC04988%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for PC04988: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY14348%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for HY14348: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU52750%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for UU52750: 0
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-28 06:37:13 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE95300%27 HTTP/1.1" 200 None
2026-03-28 06:37:13 [auto1.be] INFO: Scrape type for GE95300: 0
2026-03-28 06:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:15 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN79579%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for XN79579: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP34819%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for TP34819: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV25434%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for MV25434: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ13946%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for XZ13946: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC83971%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for JC83971: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ63338%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for VJ63338: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT11413%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for KT11413: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY09771%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for HY09771: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ75207%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for FJ75207: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL87249%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for EL87249: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS70966%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for VS70966: 0
2026-03-28 06:37:15 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-28 06:37:15 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-28 06:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:16 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR03762%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for LR03762: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH43502%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for HH43502: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE21828%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for CE21828: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR17508%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for JR17508: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for CK64923: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS34473%27 HTTP/1.1" 200 None
2026-03-28 06:37:16 [auto1.be] INFO: Scrape type for MS34473: 0
2026-03-28 06:37:16 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 06:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-28 06:37:17 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-28 06:37:17 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-28 06:37:17 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-28 06:37:17 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-28 06:37:17 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-28 06:37:17 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-28 06:37:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:18 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW24606%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for WW24606: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF96553%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for VF96553: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR55859%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for TR55859: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL68944%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for SL68944: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP59959%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for CP59959: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU40891%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for ZU40891: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM95515%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for PM95515: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-28 06:37:18 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 06:37:18 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 06:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:29 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA13965%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for MA13965: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL31605%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for XL31605: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM57328%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for AM57328: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV08195%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for FV08195: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for PW35881: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for ZG24921: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for GC38550: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for TH87974: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for XL16576: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-28 06:37:29 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 06:37:29 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-28 06:37:30 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-28 06:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:31 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST31185%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for ST31185: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT92928%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for WT92928: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT14549%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for VT14549: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG79733%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for WG79733: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB76910%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for GB76910: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF72066%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for WF72066: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR14818%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for RR14818: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for RC34183: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-28 06:37:31 [auto1.be] INFO: Scrape type for VZ41655: 0
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-28 06:37:31 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 06:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:42 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:42 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 06:37:42 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 06:37:42 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 06:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-28 06:37:42 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for TY10971: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for DL37030: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for BU79691: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 06:37:43 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-28 06:37:43 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-28 06:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:44 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-28 06:37:44 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-28 06:37:44 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-28 06:37:44 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-28 06:37:44 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 06:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-28 06:37:45 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 06:37:45 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 06:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:46 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for HL14568: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for BW89679: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for KV58178: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN53703%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for UN53703: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 06:37:46 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-28 06:37:46 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-28 06:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:47 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for YJ60132: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ69250%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for FJ69250: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for CB60498: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-28 06:37:47 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-28 06:37:47 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-28 06:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:49 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for ZD51863: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for MD39375: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-28 06:37:49 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-28 06:37:49 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 06:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:50 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-28 06:37:50 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 06:37:50 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 06:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:51 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1663 | hits on page: 40
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-28 06:37:51 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-28 06:37:51 [auto1.be] INFO: Scrape type for NY53837: 0
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-28 06:37:51 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV40639%27 HTTP/1.1" 200 None
2026-03-28 06:37:51 [auto1.be] INFO: Scrape type for FV40639: 0
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-28 06:37:51 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU84298%27 HTTP/1.1" 200 None
2026-03-28 06:37:51 [auto1.be] INFO: Scrape type for JU84298: 0
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 06:37:51 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 06:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for BC23353: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-28 06:37:52 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF18972%27 HTTP/1.1" 200 None
2026-03-28 06:37:52 [auto1.be] INFO: Scrape type for JF18972: 0
2026-03-28 06:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:53 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1663 | hits on page: 23
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA37935%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for YA37935: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ45584%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for JJ45584: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-28 06:37:53 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-28 06:37:53 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-28 06:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:37:55 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1663 | hits on page: 0
2026-03-28 06:37:55 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 06:37:55 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-28 06:37:55 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 302, <ScrapeType.BATCH_SKIPPED: 5>: 320}
2026-03-28 06:37:56 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (166 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-28T06_35_00.jl
2026-03-28 06:37:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 131963,
 'downloader/request_count': 47,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 45,
 'downloader/response_bytes': 7887425,
 'downloader/response_count': 47,
 'downloader/response_status_count/200': 47,
 'elapsed_time_seconds': 169.273965,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 6, 37, 55, 974398, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 166,
 'log_count/DEBUG': 2945,
 'log_count/INFO': 3955,
 'memusage/max': 163196928,
 'memusage/startup': 148160512,
 'request_depth_max': 46,
 'response_received_count': 47,
 'scheduler/dequeued': 47,
 'scheduler/dequeued/memory': 47,
 'scheduler/enqueued': 47,
 'scheduler/enqueued/memory': 47,
 'scrape_type/batch_skipped': 882,
 'scrape_type/price_update': 166,
 'scrape_type/skipped': 655,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 47,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.7482095967898976,
 'scrapy-zyte-api/mean_response_seconds': 2.8699963559654162,
 'scrapy-zyte-api/processed': 47,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 47,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 46,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 47,
 'scrapy-zyte-api/request_args/httpRequestBody': 45,
 'scrapy-zyte-api/request_args/httpRequestMethod': 45,
 'scrapy-zyte-api/request_args/httpResponseBody': 47,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 47,
 'scrapy-zyte-api/request_args/sessionContext': 47,
 'scrapy-zyte-api/request_args/url': 47,
 'scrapy-zyte-api/status_codes/200': 47,
 'scrapy-zyte-api/success': 47,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1703,
 'source/total_available': 1663,
 'start_time': datetime.datetime(2026, 3, 28, 6, 35, 6, 700433, tzinfo=datetime.timezone.utc)}
2026-03-28 06:37:56 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 06:37:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0c206132d0>
2026-03-28 06:37:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0c20483f90>